[2026-09-16T08:47:33.213Z] Started by upstream project "anvil/anvil-build-cron" build number 167 [2026-09-16T08:47:33.213Z] originally caused by: [2026-09-16T08:47:33.213Z] Started by timer [2026-09-16T08:47:35.210Z] Obtained pipelines/projects/anvil/build-functional-testing/Jenkinsfile from git https://github.com/kronosnet/ci-tools [2026-09-16T08:47:35.218Z] Loading library ProjectLib@main:pipelines/projects/anvil/ [2026-09-16T08:47:35.419Z] Examining kronosnet/ci-tools [2026-09-16T08:47:35.419Z] Attempting to resolve main as a branch [2026-09-16T08:47:35.602Z] Resolved main as branch main at revision cc5c7600cee5596b36707963786396bd2870c53e [2026-09-16T08:47:35.603Z] Selected Git installation does not exist. Using Default [2026-09-16T08:47:35.603Z] The recommended git tool is: NONE [2026-09-16T08:47:35.603Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9 [2026-09-16T08:47:35.606Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead. [2026-09-16T08:47:35.606Z] Wiping out workspace first. [2026-09-16T08:47:35.635Z] Cloning the remote Git repository [2026-09-16T08:47:35.635Z] Using shallow clone with depth 1 [2026-09-16T08:47:35.635Z] Avoid fetching tags [2026-09-16T08:47:35.635Z] Honoring refspec on initial clone [2026-09-16T08:47:35.635Z] Cloning repository https://github.com/kronosnet/ci-tools.git [2026-09-16T08:47:35.635Z] > git init /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10 [2026-09-16T08:47:35.649Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git [2026-09-16T08:47:35.649Z] > git --version # timeout=10 [2026-09-16T08:47:35.658Z] > git --version # 'git version 2.52.0' [2026-09-16T08:47:35.658Z] using GIT_ASKPASS to set credentials getCredUUID - github [2026-09-16T08:47:35.665Z] > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10 [2026-09-16T08:47:36.502Z] > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10 [2026-09-16T08:47:36.513Z] > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10 [2026-09-16T08:47:36.525Z] Avoid second fetch [2026-09-16T08:47:36.525Z] Checking out Revision cc5c7600cee5596b36707963786396bd2870c53e (main) [2026-09-16T08:47:36.525Z] > git config core.sparsecheckout # timeout=10 [2026-09-16T08:47:36.534Z] > git checkout -f cc5c7600cee5596b36707963786396bd2870c53e # timeout=10 [2026-09-16T08:47:36.571Z] Commit message: "pyproject: add pyproject-rpm-macros" [2026-09-16T08:47:36.582Z] Loading library GlobalLib@main:./pipelines/libs/global/ [2026-09-16T08:47:36.793Z] Examining kronosnet/ci-tools [2026-09-16T08:47:36.793Z] Attempting to resolve main as a branch [2026-09-16T08:47:36.966Z] Resolved main as branch main at revision cc5c7600cee5596b36707963786396bd2870c53e [2026-09-16T08:47:36.967Z] Selected Git installation does not exist. Using Default [2026-09-16T08:47:36.967Z] The recommended git tool is: NONE [2026-09-16T08:47:36.968Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9 [2026-09-16T08:47:36.970Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead. [2026-09-16T08:47:36.970Z] Wiping out workspace first. [2026-09-16T08:47:36.993Z] Cloning the remote Git repository [2026-09-16T08:47:36.993Z] Using shallow clone with depth 1 [2026-09-16T08:47:36.993Z] Avoid fetching tags [2026-09-16T08:47:36.993Z] Honoring refspec on initial clone [2026-09-16T08:47:36.993Z] Cloning repository https://github.com/kronosnet/ci-tools.git [2026-09-16T08:47:36.993Z] > git init /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10 [2026-09-16T08:47:37.004Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git [2026-09-16T08:47:37.004Z] > git --version # timeout=10 [2026-09-16T08:47:37.011Z] > git --version # 'git version 2.52.0' [2026-09-16T08:47:37.011Z] using GIT_ASKPASS to set credentials getCredUUID - github [2026-09-16T08:47:37.018Z] > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10 [2026-09-16T08:47:37.802Z] > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10 [2026-09-16T08:47:37.813Z] > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10 [2026-09-16T08:47:37.822Z] Avoid second fetch [2026-09-16T08:47:37.823Z] Checking out Revision cc5c7600cee5596b36707963786396bd2870c53e (main) [2026-09-16T08:47:37.823Z] > git config core.sparsecheckout # timeout=10 [2026-09-16T08:47:37.830Z] > git checkout -f cc5c7600cee5596b36707963786396bd2870c53e # timeout=10 [2026-09-16T08:47:37.867Z] Commit message: "pyproject: add pyproject-rpm-macros" [2026-09-16T08:47:37.935Z] [Pipeline] Start of Pipeline [2026-09-16T08:47:38.050Z] [Pipeline] node [2026-09-16T08:47:38.225Z] Running on anvil-ci-bm-phy06 in /srv/workspace/anvil/anvil-build-functional-testing [2026-09-16T08:47:38.225Z] [Pipeline] { [2026-09-16T08:47:38.236Z] [Pipeline] stage [2026-09-16T08:47:38.236Z] [Pipeline] { (Prep build env) [2026-09-16T08:47:38.248Z] [Pipeline] script [2026-09-16T08:47:38.252Z] [Pipeline] { [2026-09-16T08:47:38.256Z] [Pipeline] cleanWs [2026-09-16T08:47:38.339Z] [WS-CLEANUP] Deleting project workspace... [2026-09-16T08:47:38.339Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [2026-09-16T08:47:38.380Z] [WS-CLEANUP] done [2026-09-16T08:47:38.403Z] [Pipeline] lock [2026-09-16T08:47:38.403Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT] [2026-09-16T08:47:38.403Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created. [2026-09-16T08:47:38.403Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT] [2026-09-16T08:47:38.404Z] [Pipeline] { [2026-09-16T08:47:38.406Z] [Pipeline] } [2026-09-16T08:47:38.407Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT] [2026-09-16T08:47:38.409Z] [Pipeline] // lock [2026-09-16T08:47:38.414Z] [Pipeline] } [2026-09-16T08:47:38.416Z] [Pipeline] // script [2026-09-16T08:47:38.419Z] [Pipeline] } [2026-09-16T08:47:38.421Z] [Pipeline] // stage [2026-09-16T08:47:38.424Z] [Pipeline] stage [2026-09-16T08:47:38.425Z] [Pipeline] { (Run functional testing) [2026-09-16T08:47:38.432Z] [Pipeline] script [2026-09-16T08:47:38.436Z] [Pipeline] { [2026-09-16T08:47:38.456Z] [Pipeline] echo [2026-09-16T08:47:38.457Z] runWithTimeout 360 [2026-09-16T08:47:38.457Z] [Pipeline] timeout [2026-09-16T08:47:38.457Z] Timeout set to expire in 6 hr 0 min [2026-09-16T08:47:38.458Z] [Pipeline] { [2026-09-16T08:47:38.463Z] [Pipeline] sh [2026-09-16T08:47:39.168Z] + /root/ci-tools/ci-wrap ci-setup-anvil-bm-vm almalinux-9 enterprise-staging none all [2026-09-16T08:47:39.168Z] CITBRANCH: main [2026-09-16T08:47:39.168Z] CITHOME: /root/ci-tools [2026-09-16T08:47:39.168Z] CITCMD: ci-setup-anvil-bm-vm [2026-09-16T08:47:39.168Z] CITCMDARGS: almalinux-9 enterprise-staging none all [2026-09-16T08:47:39.168Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts. [2026-09-16T08:47:39.168Z] Genering ssh keys and ssh config [2026-09-16T08:47:40.083Z] Delay build by 180 seconds to allow Jenkins to cancel the job [2026-09-16T08:50:51.229Z] Destroying VMs (if any) [2026-09-16T08:50:51.229Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts. [2026-09-16T08:50:51.229Z] Genering ssh keys and ssh config [2026-09-16T08:50:51.229Z] Cache already updated [2026-09-16T08:50:51.229Z] Creating nodes disks [2026-09-16T08:50:52.103Z] Formatting 'an-striker01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.103Z] Formatting 'an-striker01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.103Z] Formatting 'an-striker02-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-striker02-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01n01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01n01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01n02-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01n02-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01dr01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Formatting 'an-a01dr01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16 [2026-09-16T08:50:52.515Z] Generating an-test-deployX kickstart files/isos [2026-09-16T08:50:52.515Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project. [2026-09-16T08:50:52.515Z] [2026-09-16T08:50:52.515Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy1.iso' [2026-09-16T08:50:52.515Z] Media current: stdio file, overwriteable [2026-09-16T08:50:52.515Z] Media status : is blank [2026-09-16T08:50:52.515Z] Media summary: 0 sessions, 0 data blocks, 0 data, 799g free [2026-09-16T08:50:52.515Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks1' [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.515Z] ISO image produced: 184 sectors [2026-09-16T08:50:52.515Z] Written to medium : 184 sectors at LBA 0 [2026-09-16T08:50:52.515Z] Writing to 'stdio:/srv/anvil/snapshots/deploy1.iso' completed successfully. [2026-09-16T08:50:52.515Z] [2026-09-16T08:50:52.515Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project. [2026-09-16T08:50:52.515Z] [2026-09-16T08:50:52.515Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy2.iso' [2026-09-16T08:50:52.515Z] Media current: stdio file, overwriteable [2026-09-16T08:50:52.515Z] Media status : is blank [2026-09-16T08:50:52.515Z] Media summary: 0 sessions, 0 data blocks, 0 data, 799g free [2026-09-16T08:50:52.515Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks2' [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.515Z] ISO image produced: 184 sectors [2026-09-16T08:50:52.515Z] Written to medium : 184 sectors at LBA 0 [2026-09-16T08:50:52.515Z] Writing to 'stdio:/srv/anvil/snapshots/deploy2.iso' completed successfully. [2026-09-16T08:50:52.515Z] [2026-09-16T08:50:52.515Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project. [2026-09-16T08:50:52.515Z] [2026-09-16T08:50:52.515Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy3.iso' [2026-09-16T08:50:52.515Z] Media current: stdio file, overwriteable [2026-09-16T08:50:52.515Z] Media status : is blank [2026-09-16T08:50:52.515Z] Media summary: 0 sessions, 0 data blocks, 0 data, 799g free [2026-09-16T08:50:52.515Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks3' [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.515Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.928Z] ISO image produced: 184 sectors [2026-09-16T08:50:52.928Z] Written to medium : 184 sectors at LBA 0 [2026-09-16T08:50:52.928Z] Writing to 'stdio:/srv/anvil/snapshots/deploy3.iso' completed successfully. [2026-09-16T08:50:52.928Z] [2026-09-16T08:50:52.928Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project. [2026-09-16T08:50:52.928Z] [2026-09-16T08:50:52.928Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy4.iso' [2026-09-16T08:50:52.928Z] Media current: stdio file, overwriteable [2026-09-16T08:50:52.928Z] Media status : is blank [2026-09-16T08:50:52.928Z] Media summary: 0 sessions, 0 data blocks, 0 data, 799g free [2026-09-16T08:50:52.928Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks4' [2026-09-16T08:50:52.928Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.928Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.928Z] ISO image produced: 184 sectors [2026-09-16T08:50:52.928Z] Written to medium : 184 sectors at LBA 0 [2026-09-16T08:50:52.928Z] Writing to 'stdio:/srv/anvil/snapshots/deploy4.iso' completed successfully. [2026-09-16T08:50:52.928Z] [2026-09-16T08:50:52.928Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project. [2026-09-16T08:50:52.928Z] [2026-09-16T08:50:52.928Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy5.iso' [2026-09-16T08:50:52.928Z] Media current: stdio file, overwriteable [2026-09-16T08:50:52.928Z] Media status : is blank [2026-09-16T08:50:52.928Z] Media summary: 0 sessions, 0 data blocks, 0 data, 799g free [2026-09-16T08:50:52.928Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks5' [2026-09-16T08:50:52.928Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.928Z] xorriso : UPDATE : 1 files added in 1 seconds [2026-09-16T08:50:52.928Z] ISO image produced: 184 sectors [2026-09-16T08:50:52.928Z] Written to medium : 184 sectors at LBA 0 [2026-09-16T08:50:52.928Z] Writing to 'stdio:/srv/anvil/snapshots/deploy5.iso' completed successfully. [2026-09-16T08:50:52.928Z] [2026-09-16T08:50:52.928Z] Generating cloud-init configs [2026-09-16T08:50:52.928Z] Generating cloud-init metadata and seed images [2026-09-16T08:50:53.341Z] wrote /srv/anvil/snapshots/an-striker01-seed.img with filesystem=iso9660 and diskformat=raw [2026-09-16T08:50:53.342Z] wrote /srv/anvil/snapshots/an-striker02-seed.img with filesystem=iso9660 and diskformat=raw [2026-09-16T08:50:53.754Z] wrote /srv/anvil/snapshots/an-a01n01-seed.img with filesystem=iso9660 and diskformat=raw [2026-09-16T08:50:53.754Z] wrote /srv/anvil/snapshots/an-a01n02-seed.img with filesystem=iso9660 and diskformat=raw [2026-09-16T08:50:53.754Z] wrote /srv/anvil/snapshots/an-a01dr01-seed.img with filesystem=iso9660 and diskformat=raw [2026-09-16T08:50:53.754Z] Creating VMs [2026-09-16T08:50:56.433Z] [2026-09-16T08:50:56.433Z] Starting install... [2026-09-16T08:50:56.433Z] [2026-09-16T08:50:56.433Z] Creating domain... | 00:00 [2026-09-16T08:50:56.433Z] Domain creation completed. [2026-09-16T08:50:58.430Z] [2026-09-16T08:50:58.430Z] Starting install... [2026-09-16T08:50:58.430Z] [2026-09-16T08:50:58.430Z] Creating domain... | 00:00 [2026-09-16T08:50:58.430Z] Domain creation completed. [2026-09-16T08:51:01.109Z] [2026-09-16T08:51:01.109Z] Starting install... [2026-09-16T08:51:01.109Z] [2026-09-16T08:51:01.109Z] Creating domain... | 00:00 [2026-09-16T08:51:01.109Z] Domain creation completed. [2026-09-16T08:51:03.790Z] [2026-09-16T08:51:03.790Z] Starting install... [2026-09-16T08:51:03.790Z] [2026-09-16T08:51:03.790Z] Creating domain... | 00:00 [2026-09-16T08:51:03.790Z] Domain creation completed. [2026-09-16T08:51:05.784Z] [2026-09-16T08:51:05.784Z] Starting install... [2026-09-16T08:51:05.784Z] [2026-09-16T08:51:05.784Z] Creating domain... | 00:00 [2026-09-16T08:51:05.784Z] Domain creation completed. [2026-09-16T08:51:05.784Z] Waiting for nodes and cloud-init to complete full init [2026-09-16T08:51:09.236Z] cloud-init status node an-striker01: [2026-09-16T08:51:12.691Z] cloud-init status node an-striker02: [2026-09-16T08:51:15.370Z] cloud-init status node an-a01n01: [2026-09-16T08:51:18.830Z] cloud-init status node an-a01n02: [2026-09-16T08:51:22.204Z] cloud-init status node an-a01dr01: [2026-09-16T08:51:22.204Z] Wed Sep 16 04:51:21 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:51:35.164Z] cloud-init status node an-striker01: running [2026-09-16T08:51:35.164Z] cloud-init status node an-striker02: running [2026-09-16T08:51:36.103Z] cloud-init status node an-a01n01: running [2026-09-16T08:51:36.593Z] cloud-init status node an-a01n02: running [2026-09-16T08:51:37.535Z] cloud-init status node an-a01dr01: running [2026-09-16T08:51:37.535Z] Wed Sep 16 04:51:37 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:51:49.398Z] cloud-init status node an-striker01: running [2026-09-16T08:51:52.381Z] cloud-init status node an-striker02: running [2026-09-16T08:51:54.034Z] cloud-init status node an-a01n01: running [2026-09-16T08:51:55.839Z] cloud-init status node an-a01n02: running [2026-09-16T08:51:58.283Z] cloud-init status node an-a01dr01: running [2026-09-16T08:51:58.283Z] Wed Sep 16 04:51:57 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:52:09.977Z] cloud-init status node an-striker01: running [2026-09-16T08:52:11.177Z] cloud-init status node an-striker02: running [2026-09-16T08:52:13.626Z] cloud-init status node an-a01n01: running [2026-09-16T08:52:15.544Z] cloud-init status node an-a01n02: running [2026-09-16T08:52:17.254Z] cloud-init status node an-a01dr01: running [2026-09-16T08:52:17.254Z] Wed Sep 16 04:52:17 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:52:30.161Z] cloud-init status node an-striker01: running [2026-09-16T08:52:30.161Z] cloud-init status node an-striker02: running [2026-09-16T08:52:32.323Z] cloud-init status node an-a01n01: running [2026-09-16T08:52:34.396Z] cloud-init status node an-a01n02: running [2026-09-16T08:52:36.064Z] cloud-init status node an-a01dr01: running [2026-09-16T08:52:36.064Z] Wed Sep 16 04:52:35 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:52:48.094Z] cloud-init status node an-striker01: running [2026-09-16T08:52:49.710Z] cloud-init status node an-striker02: running [2026-09-16T08:52:50.764Z] cloud-init status node an-a01n01: running [2026-09-16T08:52:51.751Z] cloud-init status node an-a01n02: running [2026-09-16T08:52:52.647Z] cloud-init status node an-a01dr01: running [2026-09-16T08:52:52.647Z] Wed Sep 16 04:52:52 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:53:04.494Z] cloud-init status node an-striker01: running [2026-09-16T08:53:04.494Z] cloud-init status node an-striker02: running [2026-09-16T08:53:04.907Z] cloud-init status node an-a01n01: running [2026-09-16T08:53:06.303Z] cloud-init status node an-a01n02: running [2026-09-16T08:53:07.180Z] cloud-init status node an-a01dr01: running [2026-09-16T08:53:07.180Z] Wed Sep 16 04:53:06 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:53:19.019Z] cloud-init status node an-striker01: running [2026-09-16T08:53:19.019Z] cloud-init status node an-striker02: running [2026-09-16T08:53:19.905Z] cloud-init status node an-a01n01: running [2026-09-16T08:53:32.028Z] cloud-init status node an-a01n02: running [2026-09-16T08:53:32.028Z] cloud-init status node an-a01dr01: running [2026-09-16T08:53:32.028Z] Wed Sep 16 04:53:31 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:53:49.057Z] cloud-init status node an-striker01: running [2026-09-16T08:53:49.057Z] cloud-init status node an-striker02: running [2026-09-16T08:53:49.933Z] cloud-init status node an-a01n01: running [2026-09-16T08:53:50.807Z] cloud-init status node an-a01n02: running [2026-09-16T08:53:52.205Z] cloud-init status node an-a01dr01: running [2026-09-16T08:53:52.205Z] Wed Sep 16 04:53:51 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:54:04.033Z] cloud-init status node an-striker01: running [2026-09-16T08:54:04.033Z] cloud-init status node an-striker02: running [2026-09-16T08:54:04.910Z] cloud-init status node an-a01n01: running [2026-09-16T08:54:06.309Z] cloud-init status node an-a01n02: running [2026-09-16T08:54:07.717Z] cloud-init status node an-a01dr01: running [2026-09-16T08:54:07.717Z] Wed Sep 16 04:54:07 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:54:24.772Z] cloud-init status node an-striker01: running [2026-09-16T08:54:24.772Z] cloud-init status node an-striker02: running [2026-09-16T08:54:25.979Z] cloud-init status node an-a01n01: running [2026-09-16T08:54:26.896Z] cloud-init status node an-a01n02: running [2026-09-16T08:54:27.776Z] cloud-init status node an-a01dr01: running [2026-09-16T08:54:27.776Z] Wed Sep 16 04:54:27 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:54:39.604Z] cloud-init status node an-striker01: running [2026-09-16T08:54:39.604Z] cloud-init status node an-striker02: running [2026-09-16T08:54:40.999Z] cloud-init status node an-a01n01: running [2026-09-16T08:54:41.873Z] cloud-init status node an-a01n02: running [2026-09-16T08:54:42.748Z] cloud-init status node an-a01dr01: running [2026-09-16T08:54:42.748Z] Wed Sep 16 04:54:42 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:54:54.565Z] cloud-init status node an-striker01: running [2026-09-16T08:54:55.438Z] cloud-init status node an-striker02: running [2026-09-16T08:54:57.434Z] cloud-init status node an-a01n01: running [2026-09-16T08:54:58.315Z] cloud-init status node an-a01n02: running [2026-09-16T08:54:59.715Z] cloud-init status node an-a01dr01: running [2026-09-16T08:54:59.715Z] Wed Sep 16 04:54:59 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:55:11.536Z] cloud-init status node an-striker01: running [2026-09-16T08:55:11.948Z] cloud-init status node an-striker02: running [2026-09-16T08:55:13.946Z] cloud-init status node an-a01n01: running [2026-09-16T08:55:15.947Z] cloud-init status node an-a01n02: running [2026-09-16T08:55:17.346Z] cloud-init status node an-a01dr01: running [2026-09-16T08:55:17.346Z] Wed Sep 16 04:55:16 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:55:29.170Z] cloud-init status node an-striker01: running [2026-09-16T08:55:29.170Z] cloud-init status node an-striker02: running [2026-09-16T08:55:30.566Z] cloud-init status node an-a01n01: running [2026-09-16T08:55:31.440Z] cloud-init status node an-a01n02: running [2026-09-16T08:55:32.316Z] cloud-init status node an-a01dr01: running [2026-09-16T08:55:32.316Z] Wed Sep 16 04:55:32 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:55:44.154Z] cloud-init status node an-striker01: running [2026-09-16T08:55:44.154Z] cloud-init status node an-striker02: running [2026-09-16T08:55:45.027Z] cloud-init status node an-a01n01: running [2026-09-16T08:55:45.903Z] cloud-init status node an-a01n02: running [2026-09-16T08:55:47.300Z] cloud-init status node an-a01dr01: running [2026-09-16T08:55:47.300Z] Wed Sep 16 04:55:46 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:55:59.118Z] cloud-init status node an-striker01: running [2026-09-16T08:55:59.118Z] cloud-init status node an-striker02: running [2026-09-16T08:55:59.993Z] cloud-init status node an-a01n01: running [2026-09-16T08:56:00.867Z] cloud-init status node an-a01n02: running [2026-09-16T08:56:01.740Z] cloud-init status node an-a01dr01: running [2026-09-16T08:56:01.740Z] Wed Sep 16 04:56:01 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:56:13.553Z] cloud-init status node an-striker01: running [2026-09-16T08:56:15.553Z] cloud-init status node an-striker02: running [2026-09-16T08:56:16.428Z] cloud-init status node an-a01n01: running [2026-09-16T08:56:17.306Z] cloud-init status node an-a01n02: running [2026-09-16T08:56:18.705Z] cloud-init status node an-a01dr01: running [2026-09-16T08:56:18.705Z] Wed Sep 16 04:56:18 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:56:30.521Z] cloud-init status node an-striker01: running [2026-09-16T08:56:30.521Z] cloud-init status node an-striker02: running [2026-09-16T08:56:31.393Z] cloud-init status node an-a01n01: running [2026-09-16T08:56:32.787Z] cloud-init status node an-a01n02: running [2026-09-16T08:56:33.659Z] cloud-init status node an-a01dr01: running [2026-09-16T08:56:33.659Z] Wed Sep 16 04:56:33 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:56:45.468Z] cloud-init status node an-striker01: running [2026-09-16T08:56:45.468Z] cloud-init status node an-striker02: running [2026-09-16T08:56:46.343Z] cloud-init status node an-a01n01: running [2026-09-16T08:56:47.215Z] cloud-init status node an-a01n02: running [2026-09-16T08:56:48.610Z] cloud-init status node an-a01dr01: running [2026-09-16T08:56:48.610Z] Wed Sep 16 04:56:48 EDT 2026 actual: 0 expected: 5 [2026-09-16T08:57:00.426Z] cloud-init status node an-striker01: running [2026-09-16T08:57:00.839Z] cloud-init status node an-striker02: running [2026-09-16T08:57:02.236Z] cloud-init status node an-a01n01: running [2026-09-16T08:57:03.110Z] cloud-init status node an-a01n02: running [2026-09-16T08:57:05.782Z] cloud-init status node an-a01dr01: done [2026-09-16T08:57:05.782Z] Wed Sep 16 04:57:05 EDT 2026 actual: 1 expected: 5 [2026-09-16T08:57:19.988Z] cloud-init status node an-striker01: running [2026-09-16T08:57:20.401Z] cloud-init status node an-striker02: running [2026-09-16T08:57:22.394Z] cloud-init status node an-a01n01: done [2026-09-16T08:57:23.792Z] cloud-init status node an-a01n02: done [2026-09-16T08:57:25.190Z] cloud-init status node an-a01dr01: done [2026-09-16T08:57:25.190Z] Wed Sep 16 04:57:24 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:57:37.010Z] cloud-init status node an-striker01: running [2026-09-16T08:57:38.999Z] cloud-init status node an-striker02: running [2026-09-16T08:57:39.873Z] cloud-init status node an-a01n01: done [2026-09-16T08:57:41.311Z] cloud-init status node an-a01n02: done [2026-09-16T08:57:42.185Z] cloud-init status node an-a01dr01: done [2026-09-16T08:57:42.185Z] Wed Sep 16 04:57:41 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:57:54.002Z] cloud-init status node an-striker01: running [2026-09-16T08:57:54.876Z] cloud-init status node an-striker02: running [2026-09-16T08:57:56.274Z] cloud-init status node an-a01n01: done [2026-09-16T08:57:57.146Z] cloud-init status node an-a01n02: done [2026-09-16T08:57:58.019Z] cloud-init status node an-a01dr01: done [2026-09-16T08:57:58.019Z] Wed Sep 16 04:57:57 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:58:09.824Z] cloud-init status node an-striker01: running [2026-09-16T08:58:10.696Z] cloud-init status node an-striker02: running [2026-09-16T08:58:11.568Z] cloud-init status node an-a01n01: done [2026-09-16T08:58:12.440Z] cloud-init status node an-a01n02: done [2026-09-16T08:58:13.312Z] cloud-init status node an-a01dr01: done [2026-09-16T08:58:13.312Z] Wed Sep 16 04:58:13 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:58:25.116Z] cloud-init status node an-striker01: running [2026-09-16T08:58:25.528Z] cloud-init status node an-striker02: running [2026-09-16T08:58:26.406Z] cloud-init status node an-a01n01: done [2026-09-16T08:58:27.279Z] cloud-init status node an-a01n02: done [2026-09-16T08:58:28.152Z] cloud-init status node an-a01dr01: done [2026-09-16T08:58:28.152Z] Wed Sep 16 04:58:28 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:58:39.964Z] cloud-init status node an-striker01: running [2026-09-16T08:58:40.837Z] cloud-init status node an-striker02: running [2026-09-16T08:58:42.232Z] cloud-init status node an-a01n01: done [2026-09-16T08:58:43.105Z] cloud-init status node an-a01n02: done [2026-09-16T08:58:43.977Z] cloud-init status node an-a01dr01: done [2026-09-16T08:58:43.977Z] Wed Sep 16 04:58:43 EDT 2026 actual: 3 expected: 5 [2026-09-16T08:58:55.789Z] cloud-init status node an-striker01: running [2026-09-16T08:58:59.243Z] cloud-init status node an-striker02: done [2026-09-16T08:58:59.656Z] cloud-init status node an-a01n01: done [2026-09-16T08:59:01.051Z] cloud-init status node an-a01n02: done [2026-09-16T08:59:01.924Z] cloud-init status node an-a01dr01: done [2026-09-16T08:59:01.924Z] Wed Sep 16 04:59:01 EDT 2026 actual: 4 expected: 5 [2026-09-16T08:59:16.130Z] cloud-init status node an-striker01: done [2026-09-16T08:59:16.130Z] cloud-init status node an-striker02: done [2026-09-16T08:59:17.001Z] cloud-init status node an-a01n01: done [2026-09-16T08:59:17.874Z] cloud-init status node an-a01n02: done [2026-09-16T08:59:18.746Z] cloud-init status node an-a01dr01: done [2026-09-16T08:59:18.746Z] Wed Sep 16 04:59:18 EDT 2026 actual: 5 expected: 5 [2026-09-16T08:59:18.746Z] Building simengine model [2026-09-16T08:59:40.550Z] Generating anvil striker auto config [2026-09-16T08:59:42.011Z] Cloning into 'anvil-test-suite'... [2026-09-16T08:59:42.431Z] generated ansible config: [2026-09-16T08:59:42.431Z] ========================= [2026-09-16T08:59:42.431Z] [defaults] [2026-09-16T08:59:42.431Z] inventory = ansible-inventory [2026-09-16T08:59:42.431Z] forks = 500 [2026-09-16T08:59:42.431Z] any_errors_fatal = true [2026-09-16T08:59:42.431Z] display_args_to_stdout = true [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:42.431Z] [ssh_connection] [2026-09-16T08:59:42.431Z] retries = 20 [2026-09-16T08:59:42.431Z] ========================= [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:42.431Z] generated ansible inventory: [2026-09-16T08:59:42.431Z] ============================ [2026-09-16T08:59:42.431Z] [strikers] [2026-09-16T08:59:42.431Z] an-striker01 [2026-09-16T08:59:42.431Z] an-striker02 [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:42.431Z] [nodes] [2026-09-16T08:59:42.431Z] an-a01n01 [2026-09-16T08:59:42.431Z] an-a01n02 [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:42.431Z] [drnodes] [2026-09-16T08:59:42.431Z] ============================ [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:42.431Z] Checking connectivity to nodes [2026-09-16T08:59:42.431Z] [2026-09-16T08:59:44.551Z] an-a01n01 | SUCCESS => { [2026-09-16T08:59:44.551Z] "ansible_facts": { [2026-09-16T08:59:44.551Z] "discovered_interpreter_python": "/usr/bin/python3" [2026-09-16T08:59:44.551Z] }, [2026-09-16T08:59:44.551Z] "changed": false, [2026-09-16T08:59:44.551Z] "ping": "pong" [2026-09-16T08:59:44.551Z] } [2026-09-16T08:59:44.551Z] an-striker02 | SUCCESS => { [2026-09-16T08:59:44.551Z] "ansible_facts": { [2026-09-16T08:59:44.551Z] "discovered_interpreter_python": "/usr/bin/python3" [2026-09-16T08:59:44.551Z] }, [2026-09-16T08:59:44.551Z] "changed": false, [2026-09-16T08:59:44.551Z] "ping": "pong" [2026-09-16T08:59:44.551Z] } [2026-09-16T08:59:44.551Z] an-a01n02 | SUCCESS => { [2026-09-16T08:59:44.551Z] "ansible_facts": { [2026-09-16T08:59:44.551Z] "discovered_interpreter_python": "/usr/bin/python3" [2026-09-16T08:59:44.551Z] }, [2026-09-16T08:59:44.551Z] "changed": false, [2026-09-16T08:59:44.551Z] "ping": "pong" [2026-09-16T08:59:44.551Z] } [2026-09-16T08:59:44.551Z] an-striker01 | SUCCESS => { [2026-09-16T08:59:44.551Z] "ansible_facts": { [2026-09-16T08:59:44.551Z] "discovered_interpreter_python": "/usr/bin/python3" [2026-09-16T08:59:44.551Z] }, [2026-09-16T08:59:44.551Z] "changed": false, [2026-09-16T08:59:44.551Z] "ping": "pong" [2026-09-16T08:59:44.551Z] } [2026-09-16T08:59:44.551Z] [2026-09-16T08:59:45.474Z] [2026-09-16T08:59:45.474Z] PLAY [Setup all nodes] ********************************************************* [2026-09-16T08:59:45.474Z] [2026-09-16T08:59:45.474Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T08:59:48.938Z] ok: [an-a01n02] [2026-09-16T08:59:48.938Z] ok: [an-striker01] [2026-09-16T08:59:48.938Z] ok: [an-striker02] [2026-09-16T08:59:48.938Z] ok: [an-a01n01] [2026-09-16T08:59:48.938Z] [2026-09-16T08:59:48.938Z] TASK [create /opt/MegaRAID/storcli/ path=/opt/MegaRAID/storcli/, state=directory, mode=493] *** [2026-09-16T08:59:50.339Z] changed: [an-a01n02] [2026-09-16T08:59:50.339Z] changed: [an-a01n01] [2026-09-16T08:59:50.339Z] changed: [an-striker02] [2026-09-16T08:59:50.339Z] changed: [an-striker01] [2026-09-16T08:59:50.339Z] [2026-09-16T08:59:50.339Z] TASK [wipe old storcli64 path=/opt/MegaRAID/storcli/storcli64, state=absent] *** [2026-09-16T08:59:51.742Z] ok: [an-a01n02] [2026-09-16T08:59:51.742Z] ok: [an-striker01] [2026-09-16T08:59:51.742Z] ok: [an-a01n01] [2026-09-16T08:59:51.742Z] ok: [an-striker02] [2026-09-16T08:59:51.742Z] [2026-09-16T08:59:51.742Z] TASK [get latest Simengine storcli64 url=http://anvil-ci-repo.ci.alteeve.com/ci-repo/storcli64, dest=/opt/MegaRAID/storcli/storcli64, owner=root, group=root, mode=0755] *** [2026-09-16T08:59:53.739Z] changed: [an-a01n01] [2026-09-16T08:59:53.739Z] changed: [an-a01n02] [2026-09-16T08:59:53.739Z] changed: [an-striker02] [2026-09-16T08:59:53.739Z] changed: [an-striker01] [2026-09-16T08:59:53.739Z] [2026-09-16T08:59:53.739Z] PLAY [setup strikers] ********************************************************** [2026-09-16T08:59:53.739Z] [2026-09-16T08:59:53.739Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T08:59:55.730Z] ok: [an-striker01] [2026-09-16T08:59:55.730Z] ok: [an-striker02] [2026-09-16T08:59:55.730Z] [2026-09-16T08:59:55.730Z] TASK [copy striker autogenerated config src={{ deploydir }}/configs/anvil_striker_auto.cfg, dest=/root/anvil_striker_auto.cfg, owner=root, group=root, mode=0644] *** [2026-09-16T08:59:59.187Z] changed: [an-striker01] [2026-09-16T08:59:59.187Z] changed: [an-striker02] [2026-09-16T08:59:59.187Z] [2026-09-16T08:59:59.187Z] PLAY [setup lvm storage] ******************************************************* [2026-09-16T08:59:59.187Z] [2026-09-16T08:59:59.187Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:00:00.584Z] ok: [an-a01n02] [2026-09-16T09:00:00.584Z] ok: [an-a01n01] [2026-09-16T09:00:00.584Z] [2026-09-16T09:00:00.584Z] TASK [check if vg already exists _raw_params=vgs anvil-test-vg [2026-09-16T09:00:00.584Z] ] **************** [2026-09-16T09:00:01.980Z] ok: [an-a01n02] [2026-09-16T09:00:01.980Z] ok: [an-a01n01] [2026-09-16T09:00:01.980Z] [2026-09-16T09:00:01.980Z] TASK [vgcheck _raw_params=end_play] ******************************************** [2026-09-16T09:00:01.980Z] skipping: [an-a01n01] [2026-09-16T09:00:01.980Z] [2026-09-16T09:00:01.980Z] TASK [create anvil-test-vg vg=anvil-test-vg, pvs=/dev/vdb] ********************* [2026-09-16T09:00:03.378Z] changed: [an-a01n02] [2026-09-16T09:00:03.378Z] changed: [an-a01n01] [2026-09-16T09:00:03.378Z] [2026-09-16T09:00:03.378Z] PLAY [deploy anvil] ************************************************************ [2026-09-16T09:00:03.378Z] [2026-09-16T09:00:03.378Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:00:06.051Z] ok: [an-striker01] [2026-09-16T09:00:06.051Z] ok: [an-striker02] [2026-09-16T09:00:06.051Z] [2026-09-16T09:00:06.051Z] TASK [check if installation is in progress path=/root/.anvil_deployment_in_progress] *** [2026-09-16T09:00:07.020Z] ok: [an-striker01] [2026-09-16T09:00:07.020Z] ok: [an-striker02] [2026-09-16T09:00:07.020Z] [2026-09-16T09:00:07.020Z] TASK [register installation is in progress content=, dest=/root/.anvil_deployment_in_progress, force=True, owner=root, group=root, mode=0644] *** [2026-09-16T09:00:09.700Z] changed: [an-striker02] [2026-09-16T09:00:09.700Z] changed: [an-striker01] [2026-09-16T09:00:09.700Z] [2026-09-16T09:00:09.700Z] TASK [start anvil deployment and configuration _raw_params=striker-auto-initialize-all -vv --log-secure --config /root/anvil_striker_auto.cfg [2026-09-16T09:00:09.700Z] ] *** [2026-09-16T09:00:14.066Z] changed: [an-striker01] [2026-09-16T09:00:14.066Z] changed: [an-striker02] [2026-09-16T09:00:14.066Z] [2026-09-16T09:00:14.066Z] TASK [Wait up to 20 minutes for DB to be running on both strikers _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:00:14.066Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:00:14.066Z] --username=postgres anvil -t -c "SELECT COUNT(*) FROM hosts WHERE host_type = 'striker';" [2026-09-16T09:00:14.066Z] ] *** [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (120 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (120 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (119 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (119 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (118 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (118 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (117 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (117 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (116 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (116 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (115 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (115 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (114 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (114 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (113 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (113 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (112 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (112 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (111 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (111 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (110 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (110 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (109 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (109 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (108 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (108 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (107 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (107 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (106 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (106 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (105 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (105 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (104 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (104 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (103 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (103 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (102 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (102 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (101 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (101 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (100 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (100 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (99 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (99 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (98 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (98 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (97 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (97 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (96 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (96 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (95 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (95 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (94 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (94 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (93 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (93 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (92 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (92 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (91 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (91 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (90 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (90 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (89 retries left). [2026-09-16T09:06:12.061Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (89 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (88 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (88 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (87 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (87 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (86 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (86 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (85 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (85 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (84 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (84 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (83 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (83 retries left). [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (82 retries left). [2026-09-16T09:08:09.726Z] ok: [an-striker02 -> localhost] [2026-09-16T09:08:09.726Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (81 retries left). [2026-09-16T09:08:09.726Z] ok: [an-striker01 -> localhost] [2026-09-16T09:08:09.726Z] [2026-09-16T09:08:09.726Z] TASK [Wait up to 20 minutes for both striker-db-status to sync _raw_params=dbstatus="$(striker-db-status -vv --log-secure)" [2026-09-16T09:08:09.726Z] dbcon=$(echo "$dbstatus" | grep ^connections | sed -e 's#.*=##g') [2026-09-16T09:08:09.726Z] dbhosts=$(echo "$dbstatus" | grep ^host_name | wc -l) [2026-09-16T09:08:09.726Z] if [ "$dbcon" = 1 ] && [ "$dbhosts" = 2 ]; then [2026-09-16T09:08:09.726Z] echo "DB has completed sync" [2026-09-16T09:08:09.726Z] exit 0 [2026-09-16T09:08:09.726Z] fi [2026-09-16T09:08:09.726Z] if [ "$dbcon" != 2 ]; then [2026-09-16T09:08:09.726Z] echo "Detected $dbcon db connections (expected 2)" [2026-09-16T09:08:09.726Z] exit 1 [2026-09-16T09:08:09.726Z] fi [2026-09-16T09:08:09.726Z] ] *** [2026-09-16T09:08:38.924Z] FAILED - RETRYING: [an-striker02]: Wait up to 20 minutes for both striker-db-status to sync (120 retries left). [2026-09-16T09:08:38.924Z] ok: [an-striker01] [2026-09-16T09:08:38.924Z] FAILED - RETRYING: [an-striker02]: Wait up to 20 minutes for both striker-db-status to sync (119 retries left). [2026-09-16T09:08:38.924Z] ok: [an-striker02] [2026-09-16T09:08:38.924Z] [2026-09-16T09:08:38.924Z] TASK [wait up to 20 minutes for nodes to join the database _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:08:38.924Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:08:38.924Z] --username=postgres anvil -t \ [2026-09-16T09:08:38.924Z] -c "SELECT DISTINCT a.host_name, b.variable_value FROM hosts a, variables b WHERE a.host_uuid = b.variable_source_uuid AND b.variable_name = 'system::configured' ORDER BY host_name ASC;" | \ [2026-09-16T09:08:38.924Z] grep altee | \ [2026-09-16T09:08:38.924Z] grep 1$ | \ [2026-09-16T09:08:38.924Z] wc -l [2026-09-16T09:08:38.924Z] ] *** [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (120 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (120 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (119 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (119 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (118 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (118 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (117 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (117 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (116 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (116 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (115 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (115 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (114 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (114 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (113 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (113 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (112 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (112 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (111 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (111 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (110 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (110 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (109 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (109 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (108 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (108 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (107 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (107 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (106 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (106 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (105 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (105 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (104 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (104 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (103 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (103 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (102 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (102 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (101 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (101 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (100 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (100 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (99 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (99 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (98 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (98 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (97 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (97 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (96 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (96 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (95 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (95 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (94 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (94 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (93 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (93 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (92 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (92 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (91 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (91 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (90 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (90 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (89 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (89 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (88 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (88 retries left). [2026-09-16T09:14:21.706Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (87 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (87 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (86 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (86 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (85 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (85 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (84 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (84 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (83 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (83 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (82 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (82 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (81 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (81 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (80 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (80 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (79 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (79 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (78 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (78 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (77 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (77 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (76 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (76 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (75 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (75 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (74 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (74 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (73 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (73 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (72 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (72 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (71 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (71 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (70 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (70 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (69 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (69 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (68 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (68 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (67 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (67 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (66 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (66 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (65 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (65 retries left). [2026-09-16T09:18:33.506Z] ok: [an-striker02 -> localhost] [2026-09-16T09:18:33.506Z] ok: [an-striker01 -> localhost] [2026-09-16T09:18:33.506Z] [2026-09-16T09:18:33.506Z] TASK [wait up to 20 minutes for anvil nodes to form _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:18:33.506Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:18:33.506Z] --username=postgres anvil -t -c "SELECT a.host_name AS node1, b.host_name AS node2, d.anvil_name FROM hosts a, hosts b, anvils d WHERE a.host_uuid = d.anvil_node1_host_uuid AND b.host_uuid = d.anvil_node2_host_uuid;" | \ [2026-09-16T09:18:33.506Z] grep altee | \ [2026-09-16T09:18:33.506Z] wc -l [2026-09-16T09:18:33.506Z] ] *** [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for anvil nodes to form (120 retries left). [2026-09-16T09:18:33.506Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for anvil nodes to form (120 retries left). [2026-09-16T09:18:33.506Z] ok: [an-striker01 -> localhost] [2026-09-16T09:18:33.506Z] ok: [an-striker02 -> localhost] [2026-09-16T09:18:33.506Z] [2026-09-16T09:18:33.506Z] TASK [wait up to 60 minutes for pacemaker to be configured _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:18:33.506Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:18:33.506Z] --username=postgres anvil -t \ [2026-09-16T09:18:33.506Z] -c "SELECT DISTINCT a.host_name, b.variable_value FROM hosts a, variables b WHERE a.host_uuid = b.variable_source_uuid AND b.variable_name = 'system::pacemaker::configured' ORDER BY host_name ASC;" | \ [2026-09-16T09:18:33.506Z] grep altee | \ [2026-09-16T09:18:33.506Z] grep 1$ | \ [2026-09-16T09:18:33.506Z] wc -l [2026-09-16T09:18:33.506Z] ] *** [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (360 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (360 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (359 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (359 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (358 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (358 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (357 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (357 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (356 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (356 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (355 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (355 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (354 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (354 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (353 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (353 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (352 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (352 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (351 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (351 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (350 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (350 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (349 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (349 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (348 retries left). [2026-09-16T09:20:59.202Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (348 retries left). [2026-09-16T09:20:59.202Z] ok: [an-striker02 -> localhost] [2026-09-16T09:20:59.202Z] ok: [an-striker01 -> localhost] [2026-09-16T09:20:59.202Z] [2026-09-16T09:20:59.202Z] TASK [wait up to 20 minutes for drbd to be configured _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:20:59.202Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:20:59.202Z] --username=postgres anvil -t \ [2026-09-16T09:20:59.202Z] -c "SELECT DISTINCT a.host_name, b.variable_value FROM hosts a, variables b WHERE a.host_uuid = b.variable_source_uuid AND b.variable_name = 'system::drbd::configured' ORDER BY host_name ASC;" | \ [2026-09-16T09:20:59.202Z] grep altee | \ [2026-09-16T09:20:59.202Z] grep 1$ | \ [2026-09-16T09:20:59.202Z] wc -l [2026-09-16T09:20:59.202Z] ] *** [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for drbd to be configured (120 retries left). [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for drbd to be configured (120 retries left). [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for drbd to be configured (119 retries left). [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for drbd to be configured (119 retries left). [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for drbd to be configured (118 retries left). [2026-09-16T09:21:19.617Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for drbd to be configured (118 retries left). [2026-09-16T09:21:19.617Z] ok: [an-striker01 -> localhost] [2026-09-16T09:21:19.617Z] ok: [an-striker02 -> localhost] [2026-09-16T09:21:19.617Z] [2026-09-16T09:21:19.617Z] TASK [wait up to 20 minutes for any other configuration job to complete _raw_params=export PGPASSWORD={{ pgpasswd }} && \ [2026-09-16T09:21:19.617Z] psql --host="{{ inventory_hostname }}" \ [2026-09-16T09:21:19.617Z] --username=postgres anvil -t \ [2026-09-16T09:21:19.617Z] -c "SELECT DISTINCT a.host_name, b.variable_value FROM hosts a, variables b WHERE a.host_uuid = b.variable_source_uuid AND b.variable_name = 'system::all::configured' ORDER BY host_name ASC;" | \ [2026-09-16T09:21:19.617Z] grep altee | \ [2026-09-16T09:21:19.617Z] grep 1$ | \ [2026-09-16T09:21:19.617Z] wc -l [2026-09-16T09:21:19.617Z] ] *** [2026-09-16T09:21:20.028Z] ok: [an-striker01 -> localhost] [2026-09-16T09:21:20.028Z] ok: [an-striker02 -> localhost] [2026-09-16T09:21:20.028Z] [2026-09-16T09:21:20.028Z] PLAY [check network status after deployment] *********************************** [2026-09-16T09:21:20.028Z] [2026-09-16T09:21:20.028Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:21:23.485Z] ok: [an-a01n01] [2026-09-16T09:21:23.485Z] ok: [an-striker02] [2026-09-16T09:21:23.485Z] ok: [an-a01n02] [2026-09-16T09:21:23.485Z] ok: [an-striker01] [2026-09-16T09:21:23.485Z] [2026-09-16T09:21:23.485Z] TASK [check network manager autoconnect is set to yes _raw_params=device="$(nmcli device show {{ item }} | grep "GENERAL.CONNECTION:" | awk '{print $NF}')" [2026-09-16T09:21:23.485Z] if [ "$device" = "" ]; then [2026-09-16T09:21:23.485Z] echo "ERROR: unable to determine device for iface {{ item }}" [2026-09-16T09:21:23.485Z] exit 1 [2026-09-16T09:21:23.485Z] fi [2026-09-16T09:21:23.485Z] if [ "$(nmcli connection show $device | grep 'autoconnect:' | awk '{print $NF}' | sort -u)" != "yes" ]; then [2026-09-16T09:21:23.485Z] echo "ERROR: {{ item }} / $device is not set to autoconnecct" [2026-09-16T09:21:23.485Z] exit 1 [2026-09-16T09:21:23.485Z] fi [2026-09-16T09:21:23.485Z] exit 0 [2026-09-16T09:21:23.485Z] ] *** [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=bcn1_bond1) [2026-09-16T09:21:33.286Z] skipping: [an-a01n02] => (item=lo) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=bcn1_link1) [2026-09-16T09:21:33.286Z] skipping: [an-striker01] => (item=lo) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=bcn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=ifn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=ifn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=sn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=bcn1_bridge1) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=bcn1_bridge1) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=bcn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=ifn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=bcn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=ifn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=ifn1_bridge1) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=ifn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=bcn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=sn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=sn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=ifn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=sn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=ifn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=bcn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=ifn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=ifn1_bridge1) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=ifn1_bond1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=ifn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=bcn1_bond1) [2026-09-16T09:21:33.286Z] skipping: [an-striker02] => (item=lo) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=bcn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=sn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=sn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-striker02] => (item=bcn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=bcn1_link2) [2026-09-16T09:21:33.286Z] changed: [an-a01n02] => (item=bcn1_link1) [2026-09-16T09:21:33.286Z] changed: [an-a01n01] => (item=ifn1_bond1) [2026-09-16T09:21:33.286Z] skipping: [an-a01n01] => (item=lo) [2026-09-16T09:21:33.286Z] changed: [an-striker01] => (item=ifn1_link2) [2026-09-16T09:21:33.286Z] [2026-09-16T09:21:33.286Z] PLAY [check pacemaker status after deployment] ********************************* [2026-09-16T09:21:33.286Z] [2026-09-16T09:21:33.286Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:21:35.965Z] ok: [an-a01n02] [2026-09-16T09:21:35.965Z] ok: [an-a01n01] [2026-09-16T09:21:35.965Z] [2026-09-16T09:21:35.965Z] TASK [check cluster is in good state _raw_params=../common/cluster_good.yml] *** [2026-09-16T09:21:35.965Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02 [2026-09-16T09:21:35.965Z] [2026-09-16T09:21:35.965Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster _raw_params=pcs status | grep Online | grep -q "{{ item }}" [2026-09-16T09:21:35.965Z] ] *** [2026-09-16T09:21:40.325Z] ok: [an-a01n02] => (item=an-a01n01) [2026-09-16T09:21:40.325Z] ok: [an-a01n01] => (item=an-a01n01) [2026-09-16T09:21:40.325Z] ok: [an-a01n02] => (item=an-a01n02) [2026-09-16T09:21:40.325Z] ok: [an-a01n01] => (item=an-a01n02) [2026-09-16T09:21:40.325Z] [2026-09-16T09:21:40.325Z] PLAY [check drbd kmod] ********************************************************* [2026-09-16T09:21:40.325Z] [2026-09-16T09:21:40.325Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:21:42.324Z] ok: [an-a01n02] [2026-09-16T09:21:42.324Z] ok: [an-a01n01] [2026-09-16T09:21:42.324Z] [2026-09-16T09:21:42.324Z] TASK [check if drbd kernel module is already loaded _raw_params=lsmod 2>/dev/null| grep -q drbd [2026-09-16T09:21:42.324Z] ] *** [2026-09-16T09:21:43.201Z] ok: [an-a01n02] [2026-09-16T09:21:43.201Z] ok: [an-a01n01] [2026-09-16T09:21:43.201Z] [2026-09-16T09:21:43.201Z] TASK [load drbd kernel module _raw_params=modprobe drbd [2026-09-16T09:21:43.201Z] ] *********************** [2026-09-16T09:21:43.201Z] skipping: [an-a01n01] [2026-09-16T09:21:43.201Z] skipping: [an-a01n02] [2026-09-16T09:21:43.201Z] [2026-09-16T09:21:43.201Z] TASK [check if drbd kernel module is loaded _raw_params=lsmod 2>/dev/null| grep -q drbd [2026-09-16T09:21:43.201Z] ] *** [2026-09-16T09:21:43.618Z] skipping: [an-a01n01] [2026-09-16T09:21:43.618Z] skipping: [an-a01n02] [2026-09-16T09:21:43.618Z] [2026-09-16T09:21:43.618Z] PLAY [Copy iso images to striker01] ******************************************** [2026-09-16T09:21:43.618Z] [2026-09-16T09:21:43.618Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:21:47.081Z] ok: [an-striker01] [2026-09-16T09:21:47.081Z] [2026-09-16T09:21:47.081Z] TASK [Wipe old snapshots dir path=/tmp/images, state=absent] ******************* [2026-09-16T09:21:47.494Z] ok: [an-striker01] [2026-09-16T09:21:47.494Z] [2026-09-16T09:21:47.494Z] TASK [Create snapshots dir path=/tmp/images, state=directory, mode=0o700] ****** [2026-09-16T09:21:49.481Z] changed: [an-striker01] [2026-09-16T09:21:49.481Z] [2026-09-16T09:21:49.481Z] TASK [Copy C9S kickstart images src={{ deploydir }}/snapshots/{{ item }}, dest=/tmp/images/{{ item }}, owner=root, group=root, mode=0644] *** [2026-09-16T09:22:01.293Z] changed: [an-striker01] => (item=deploy1.iso) [2026-09-16T09:22:01.293Z] changed: [an-striker01] => (item=deploy2.iso) [2026-09-16T09:22:01.293Z] changed: [an-striker01] => (item=deploy3.iso) [2026-09-16T09:22:01.293Z] changed: [an-striker01] => (item=deploy4.iso) [2026-09-16T09:22:01.293Z] changed: [an-striker01] => (item=deploy5.iso) [2026-09-16T09:22:01.293Z] [2026-09-16T09:22:01.293Z] TASK [Move install isos to anvil upload dir _raw_params=mv /tmp/images/*.iso /mnt/shared/incoming/ [2026-09-16T09:22:01.293Z] ] *** [2026-09-16T09:22:01.704Z] changed: [an-striker01] [2026-09-16T09:22:01.704Z] [2026-09-16T09:22:01.704Z] TASK [Wipe old snapshots dir path=/tmp/images, state=absent] ******************* [2026-09-16T09:22:02.578Z] changed: [an-striker01] [2026-09-16T09:22:02.578Z] [2026-09-16T09:22:02.578Z] PLAY [Check iso images propagation] ******************************************** [2026-09-16T09:22:02.578Z] [2026-09-16T09:22:02.578Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:22:06.030Z] ok: [an-a01n02] [2026-09-16T09:22:06.030Z] ok: [an-a01n01] [2026-09-16T09:22:06.030Z] ok: [an-striker02] [2026-09-16T09:22:06.030Z] ok: [an-striker01] [2026-09-16T09:22:06.030Z] [2026-09-16T09:22:06.030Z] TASK [wait up to 30 minutes for all images to be propagated to all nodes _raw_params=if [ "$(ls -1 /mnt/shared/files/*.iso | wc -l)" != 6 ]; then [2026-09-16T09:22:06.030Z] exit 1 [2026-09-16T09:22:06.030Z] else [2026-09-16T09:22:06.030Z] exit 0 [2026-09-16T09:22:06.030Z] fi [2026-09-16T09:22:06.030Z] ] *** [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left). [2026-09-16T09:24:01.368Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left). [2026-09-16T09:24:01.368Z] ok: [an-striker01] [2026-09-16T09:24:01.368Z] ok: [an-striker02] [2026-09-16T09:24:01.368Z] ok: [an-a01n02] [2026-09-16T09:24:01.368Z] ok: [an-a01n01] [2026-09-16T09:24:01.368Z] [2026-09-16T09:24:01.368Z] PLAY [example tests] *********************************************************** [2026-09-16T09:24:01.368Z] [2026-09-16T09:24:01.368Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:24:01.368Z] ok: [an-a01n01] [2026-09-16T09:24:01.368Z] ok: [an-a01n02] [2026-09-16T09:24:01.368Z] ok: [an-striker01] [2026-09-16T09:24:01.368Z] ok: [an-striker02] [2026-09-16T09:24:01.368Z] [2026-09-16T09:24:01.368Z] TASK [this test should be executed only on strikers _raw_params=/usr/bin/true [2026-09-16T09:24:01.368Z] ] *** [2026-09-16T09:24:01.779Z] skipping: [an-a01n01] [2026-09-16T09:24:01.779Z] skipping: [an-a01n02] [2026-09-16T09:24:01.779Z] ok: [an-striker01] [2026-09-16T09:24:01.779Z] ok: [an-striker02] [2026-09-16T09:24:01.779Z] [2026-09-16T09:24:01.779Z] TASK [this test should be executed only on non strikers _raw_params=/usr/bin/true [2026-09-16T09:24:01.779Z] ] *** [2026-09-16T09:24:01.779Z] skipping: [an-striker01] [2026-09-16T09:24:01.779Z] skipping: [an-striker02] [2026-09-16T09:24:02.653Z] ok: [an-a01n01] [2026-09-16T09:24:02.653Z] ok: [an-a01n02] [2026-09-16T09:24:02.653Z] [2026-09-16T09:24:02.653Z] TASK [inject failure _raw_params=/usr/bin/false [2026-09-16T09:24:02.653Z] ] ******************************* [2026-09-16T09:24:02.653Z] skipping: [an-striker01] [2026-09-16T09:24:02.653Z] skipping: [an-striker02] [2026-09-16T09:24:02.653Z] skipping: [an-a01n01] [2026-09-16T09:24:02.653Z] skipping: [an-a01n02] [2026-09-16T09:24:02.653Z] [2026-09-16T09:24:02.653Z] PLAY [Record anvil available resources from striker01] ************************* [2026-09-16T09:24:02.653Z] [2026-09-16T09:24:02.653Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:24:05.329Z] ok: [an-striker01] [2026-09-16T09:24:05.329Z] [2026-09-16T09:24:05.329Z] TASK [Record anvil available resources _raw_params=anvil-report-usage > /root/anvil_available_resources.start [2026-09-16T09:24:05.329Z] ] *** [2026-09-16T09:24:08.780Z] ok: [an-striker01] [2026-09-16T09:24:08.780Z] [2026-09-16T09:24:08.780Z] PLAY [check selinux status] **************************************************** [2026-09-16T09:24:08.780Z] [2026-09-16T09:24:08.780Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:24:12.235Z] ok: [an-a01n02] [2026-09-16T09:24:12.235Z] ok: [an-a01n01] [2026-09-16T09:24:12.235Z] ok: [an-striker01] [2026-09-16T09:24:12.235Z] ok: [an-striker02] [2026-09-16T09:24:12.235Z] [2026-09-16T09:24:12.235Z] TASK [check selinux status permissive (8) var=ansible_selinux] ***************** [2026-09-16T09:24:12.235Z] skipping: [an-striker02] [2026-09-16T09:24:12.235Z] skipping: [an-striker01] [2026-09-16T09:24:12.235Z] skipping: [an-a01n01] [2026-09-16T09:24:12.235Z] skipping: [an-a01n02] [2026-09-16T09:24:12.235Z] [2026-09-16T09:24:12.235Z] TASK [check selinux status permissive (9) var=ansible_selinux] ***************** [2026-09-16T09:24:12.646Z] ok: [an-striker01] => { [2026-09-16T09:24:12.646Z] "ansible_selinux": { [2026-09-16T09:24:12.646Z] "config_mode": "enforcing", [2026-09-16T09:24:12.646Z] "mode": "enforcing", [2026-09-16T09:24:12.646Z] "policyvers": 33, [2026-09-16T09:24:12.646Z] "status": "enabled", [2026-09-16T09:24:12.646Z] "type": "targeted" [2026-09-16T09:24:12.646Z] }, [2026-09-16T09:24:12.646Z] "failed_when_result": false [2026-09-16T09:24:12.646Z] } [2026-09-16T09:24:12.646Z] ok: [an-striker02] => { [2026-09-16T09:24:12.646Z] "ansible_selinux": { [2026-09-16T09:24:12.646Z] "config_mode": "enforcing", [2026-09-16T09:24:12.646Z] "mode": "enforcing", [2026-09-16T09:24:12.646Z] "policyvers": 33, [2026-09-16T09:24:12.646Z] "status": "enabled", [2026-09-16T09:24:12.646Z] "type": "targeted" [2026-09-16T09:24:12.646Z] }, [2026-09-16T09:24:12.646Z] "failed_when_result": false [2026-09-16T09:24:12.646Z] } [2026-09-16T09:24:12.646Z] ok: [an-a01n01] => { [2026-09-16T09:24:12.646Z] "ansible_selinux": { [2026-09-16T09:24:12.646Z] "config_mode": "enforcing", [2026-09-16T09:24:12.646Z] "mode": "enforcing", [2026-09-16T09:24:12.646Z] "policyvers": 33, [2026-09-16T09:24:12.646Z] "status": "enabled", [2026-09-16T09:24:12.646Z] "type": "targeted" [2026-09-16T09:24:12.646Z] }, [2026-09-16T09:24:12.646Z] "failed_when_result": false [2026-09-16T09:24:12.646Z] } [2026-09-16T09:24:12.646Z] ok: [an-a01n02] => { [2026-09-16T09:24:12.646Z] "ansible_selinux": { [2026-09-16T09:24:12.646Z] "config_mode": "enforcing", [2026-09-16T09:24:12.646Z] "mode": "enforcing", [2026-09-16T09:24:12.646Z] "policyvers": 33, [2026-09-16T09:24:12.646Z] "status": "enabled", [2026-09-16T09:24:12.646Z] "type": "targeted" [2026-09-16T09:24:12.646Z] }, [2026-09-16T09:24:12.646Z] "failed_when_result": false [2026-09-16T09:24:12.646Z] } [2026-09-16T09:24:12.646Z] [2026-09-16T09:24:12.646Z] PLAY [Create random file on striker01] ***************************************** [2026-09-16T09:24:12.646Z] [2026-09-16T09:24:12.646Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:24:14.040Z] ok: [an-striker01] [2026-09-16T09:24:14.040Z] [2026-09-16T09:24:14.040Z] TASK [Create archive file content=foobarbaz, dest=/mnt/shared/archives/something.test, force=True, owner=root, group=root, mode=0644] *** [2026-09-16T09:24:16.709Z] changed: [an-striker01] [2026-09-16T09:24:16.709Z] [2026-09-16T09:24:16.709Z] PLAY [Check archive file propagation] ****************************************** [2026-09-16T09:24:16.709Z] [2026-09-16T09:24:16.709Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:24:19.376Z] ok: [an-a01n02] [2026-09-16T09:24:19.376Z] ok: [an-a01n01] [2026-09-16T09:24:19.376Z] ok: [an-striker01] [2026-09-16T09:24:19.376Z] ok: [an-striker02] [2026-09-16T09:24:19.376Z] [2026-09-16T09:24:19.376Z] TASK [wait up to 30 minutes for archive to be propagated to all nodes _raw_params=if [ "$(ls -1 /mnt/shared/archives/something.test | wc -l)" != 1 ]; then [2026-09-16T09:24:19.376Z] exit 1 [2026-09-16T09:24:19.376Z] else [2026-09-16T09:24:19.376Z] exit 0 [2026-09-16T09:24:19.376Z] fi [2026-09-16T09:24:19.376Z] ] *** [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left). [2026-09-16T09:25:44.344Z] ok: [an-striker01] [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (178 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (178 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (178 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (177 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (177 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (177 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (176 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (176 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (176 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (175 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (175 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (175 retries left). [2026-09-16T09:25:44.344Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (174 retries left). [2026-09-16T09:25:44.345Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (174 retries left). [2026-09-16T09:25:44.345Z] ok: [an-striker02] [2026-09-16T09:25:44.345Z] ok: [an-a01n02] [2026-09-16T09:25:44.345Z] ok: [an-a01n01] [2026-09-16T09:25:44.345Z] [2026-09-16T09:25:44.345Z] PLAY [test fencing] ************************************************************ [2026-09-16T09:25:44.345Z] [2026-09-16T09:25:44.345Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:25:44.345Z] ok: [an-a01n01] [2026-09-16T09:25:44.345Z] ok: [an-a01n02] [2026-09-16T09:25:44.345Z] [2026-09-16T09:25:44.345Z] TASK [check cluster is in good state _raw_params=../../common/cluster_good.yml] *** [2026-09-16T09:25:44.345Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02 [2026-09-16T09:25:44.345Z] [2026-09-16T09:25:44.345Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster _raw_params=pcs status | grep Online | grep -q "{{ item }}" [2026-09-16T09:25:44.345Z] ] *** [2026-09-16T09:25:45.223Z] ok: [an-a01n02] => (item=an-a01n01) [2026-09-16T09:25:45.223Z] ok: [an-a01n01] => (item=an-a01n01) [2026-09-16T09:25:45.223Z] ok: [an-a01n02] => (item=an-a01n02) [2026-09-16T09:25:45.223Z] ok: [an-a01n01] => (item=an-a01n02) [2026-09-16T09:25:45.223Z] [2026-09-16T09:25:45.223Z] TASK [kill node "an-a01n01" _raw_params=../../common/kill_node.yml] ************ [2026-09-16T09:25:45.635Z] included: /srv/anvil/anvil-test-suite/playbooks/common/kill_node.yml for an-a01n01, an-a01n02 [2026-09-16T09:25:45.635Z] [2026-09-16T09:25:45.635Z] TASK [kill node "an-a01n01" _raw_params=echo c > /proc/sysrq-trigger [2026-09-16T09:25:45.635Z] ] ********** [2026-09-16T09:25:46.508Z] skipping: [an-a01n02] [2026-09-16T09:25:46.508Z] changed: [an-a01n01] [2026-09-16T09:25:46.508Z] [2026-09-16T09:25:46.508Z] TASK [wait for node "an-a01n01" to be back online _raw_params=./wait_node.yml] *** [2026-09-16T09:25:46.508Z] skipping: [an-a01n02] [2026-09-16T09:25:46.508Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01 [2026-09-16T09:25:46.508Z] [2026-09-16T09:25:46.508Z] TASK [wait for node "an-a01n01" to be back online host={{ ansible_ssh_host }}, state=started, delay=10, timeout=180] *** [2026-09-16T09:28:57.613Z] ok: [an-a01n01 -> localhost] [2026-09-16T09:28:57.613Z] [2026-09-16T09:28:57.613Z] TASK [check cluster is in good state _raw_params=../../common/cluster_good.yml] *** [2026-09-16T09:28:57.613Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02 [2026-09-16T09:28:57.613Z] [2026-09-16T09:28:57.613Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster _raw_params=pcs status | grep Online | grep -q "{{ item }}" [2026-09-16T09:28:57.613Z] ] *** [2026-09-16T09:29:02.017Z] ok: [an-a01n02] => (item=an-a01n01) [2026-09-16T09:29:02.017Z] ok: [an-a01n01] => (item=an-a01n01) [2026-09-16T09:29:02.017Z] ok: [an-a01n02] => (item=an-a01n02) [2026-09-16T09:29:02.017Z] ok: [an-a01n01] => (item=an-a01n02) [2026-09-16T09:29:02.017Z] [2026-09-16T09:29:02.017Z] TASK [kill node "an-a01n02" _raw_params=../../common/kill_node.yml] ************ [2026-09-16T09:29:02.017Z] included: /srv/anvil/anvil-test-suite/playbooks/common/kill_node.yml for an-a01n01, an-a01n02 [2026-09-16T09:29:02.017Z] [2026-09-16T09:29:02.017Z] TASK [kill node "an-a01n02" _raw_params=echo c > /proc/sysrq-trigger [2026-09-16T09:29:02.017Z] ] ********** [2026-09-16T09:29:03.416Z] skipping: [an-a01n01] [2026-09-16T09:29:03.416Z] changed: [an-a01n02] [2026-09-16T09:29:03.416Z] [2026-09-16T09:29:03.416Z] TASK [wait for node "an-a01n02" to be back online _raw_params=./wait_node.yml] *** [2026-09-16T09:29:03.416Z] skipping: [an-a01n01] [2026-09-16T09:29:03.416Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n02 [2026-09-16T09:29:03.416Z] [2026-09-16T09:29:03.416Z] TASK [wait for node "an-a01n02" to be back online host={{ ansible_ssh_host }}, state=started, delay=10, timeout=180] *** [2026-09-16T09:32:14.562Z] ok: [an-a01n02 -> localhost] [2026-09-16T09:32:14.562Z] [2026-09-16T09:32:14.562Z] TASK [check cluster is in good state _raw_params=../../common/cluster_good.yml] *** [2026-09-16T09:32:14.562Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02 [2026-09-16T09:32:14.562Z] [2026-09-16T09:32:14.562Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster _raw_params=pcs status | grep Online | grep -q "{{ item }}" [2026-09-16T09:32:14.562Z] ] *** [2026-09-16T09:32:19.978Z] ok: [an-a01n01] => (item=an-a01n01) [2026-09-16T09:32:19.978Z] ok: [an-a01n02] => (item=an-a01n01) [2026-09-16T09:32:19.978Z] ok: [an-a01n01] => (item=an-a01n02) [2026-09-16T09:32:19.978Z] ok: [an-a01n02] => (item=an-a01n02) [2026-09-16T09:32:19.978Z] [2026-09-16T09:32:19.978Z] PLAY [advanced server tests] *************************************************** [2026-09-16T09:32:19.978Z] [2026-09-16T09:32:19.978Z] TASK [Gathering Facts ] ******************************************************** [2026-09-16T09:32:21.380Z] ok: [an-a01n01] [2026-09-16T09:32:21.380Z] ok: [an-a01n02] [2026-09-16T09:32:21.380Z] [2026-09-16T09:32:21.380Z] TASK [check cluster is in good state _raw_params=../../common/cluster_good.yml] *** [2026-09-16T09:32:21.793Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02 [2026-09-16T09:32:21.793Z] [2026-09-16T09:32:21.793Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster _raw_params=pcs status | grep Online | grep -q "{{ item }}" [2026-09-16T09:32:21.793Z] ] *** [2026-09-16T09:32:26.155Z] ok: [an-a01n01] => (item=an-a01n01) [2026-09-16T09:32:26.155Z] ok: [an-a01n02] => (item=an-a01n01) [2026-09-16T09:32:26.155Z] ok: [an-a01n02] => (item=an-a01n02) [2026-09-16T09:32:26.155Z] ok: [an-a01n01] => (item=an-a01n02) [2026-09-16T09:32:26.155Z] [2026-09-16T09:32:26.155Z] TASK [check anvil-provision-server storage group _raw_params=../../common/get_storage_group.yml] *** [2026-09-16T09:32:26.155Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_storage_group.yml for an-a01n01, an-a01n02 [2026-09-16T09:32:26.155Z] [2026-09-16T09:32:26.155Z] TASK [get anvil-provision-server storage group _raw_params=storage="$(anvil-provision-server -vv --log-secure --ci-test --options --machine | grep storage_group)" [2026-09-16T09:32:26.155Z] if [ -z "$storage" ]; then [2026-09-16T09:32:26.155Z] echo "Unable to detect shared storage" [2026-09-16T09:32:26.155Z] exit 1 [2026-09-16T09:32:26.155Z] fi [2026-09-16T09:32:26.155Z] echo "$storage" | sed -e 's#.*uuid=##g' -e 's#,.*##g' [2026-09-16T09:32:26.155Z] ] *** [2026-09-16T09:32:32.808Z] changed: [an-a01n02] [2026-09-16T09:32:32.808Z] changed: [an-a01n01] [2026-09-16T09:32:32.808Z] [2026-09-16T09:32:32.808Z] TASK [check anvil-provision-server install isos _raw_params=../../common/get_install_iso.yml] *** [2026-09-16T09:32:32.808Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_install_iso.yml for an-a01n01, an-a01n02 [2026-09-16T09:32:32.808Z] [2026-09-16T09:32:32.808Z] TASK [check anvil-provision-server install isos _raw_params=isos="$(anvil-provision-server -vv --log-secure --ci-test --options --machine | grep iso_file)" [2026-09-16T09:32:32.808Z] deployiso="$(echo "$isos" | grep "=deploy")" [2026-09-16T09:32:32.808Z] if [ "$(echo "$deployiso" | wc -l)" -lt "5" ]; then [2026-09-16T09:32:32.808Z] echo "Unable to detect all deploy iso" [2026-09-16T09:32:32.808Z] echo "Detected isos" [2026-09-16T09:32:32.808Z] echo "$isos" [2026-09-16T09:32:32.808Z] exit 1 [2026-09-16T09:32:32.808Z] fi [2026-09-16T09:32:32.808Z] installiso="$(echo "$isos" | grep -v "=deploy")" [2026-09-16T09:32:32.808Z] if [ -z "$installiso" ]; then [2026-09-16T09:32:32.808Z] echo "Unable to detect install iso" [2026-09-16T09:32:32.808Z] echo "Detected isos" [2026-09-16T09:32:32.808Z] echo "$isos" [2026-09-16T09:32:32.808Z] exit 1 [2026-09-16T09:32:32.808Z] fi [2026-09-16T09:32:32.808Z] echo "$installiso" | sed -e 's#.*uuid=##g' -e 's#,.*##g' [2026-09-16T09:32:32.808Z] ] *** [2026-09-16T09:32:38.226Z] changed: [an-a01n02] [2026-09-16T09:32:38.226Z] changed: [an-a01n01] [2026-09-16T09:32:38.226Z] [2026-09-16T09:32:38.226Z] TASK [deploy servers _raw_params=../../common/deploy_server.yml] *************** [2026-09-16T09:32:38.226Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=1) [2026-09-16T09:32:38.226Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=2) [2026-09-16T09:32:38.226Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=3) [2026-09-16T09:32:38.226Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=4) [2026-09-16T09:32:38.226Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=5) [2026-09-16T09:32:38.226Z] [2026-09-16T09:32:38.226Z] TASK [check if server an-test-deploy1 exists _raw_params=pcs status resources an-test-deploy{{ servernum }} [2026-09-16T09:32:38.226Z] ] *** [2026-09-16T09:32:40.214Z] skipping: [an-a01n02] [2026-09-16T09:32:40.214Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy1\n", "delta": "0:00:00.973474", "end": "2026-09-16 09:32:39.491204", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 09:32:38.517730", "stderr": "Error: resource or tag id 'an-test-deploy1' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy1' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T09:32:40.214Z] ...ignoring [2026-09-16T09:32:40.214Z] [2026-09-16T09:32:40.214Z] TASK [deploy server an-test-deploy1 from an-a01n01 on storage 9a2e8511-2f97-4cf0-a9d1-39bf305ffae2 _raw_params=anvil-provision-server -vv --log-secure \ [2026-09-16T09:32:40.214Z] --ci-test \ [2026-09-16T09:32:40.214Z] --name an-test-deploy{{ servernum }} \ [2026-09-16T09:32:40.214Z] --os almalinux9 \ [2026-09-16T09:32:40.214Z] --cpu 2 --ram 4G \ [2026-09-16T09:32:40.214Z] --storage-group {{ storageuuid }} --storage-size 10G \ [2026-09-16T09:32:40.214Z] --install-media {{ installisouuid }} \ [2026-09-16T09:32:40.214Z] --driver-disc deploy{{ servernum }}.iso [2026-09-16T09:32:40.214Z] ] *** [2026-09-16T09:32:50.019Z] skipping: [an-a01n02] [2026-09-16T09:32:50.019Z] changed: [an-a01n01] [2026-09-16T09:32:50.019Z] [2026-09-16T09:32:50.019Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker _raw_params=./wait_server_in_pacemaker.yml] *** [2026-09-16T09:32:50.019Z] skipping: [an-a01n01] [2026-09-16T09:32:50.019Z] skipping: [an-a01n02] [2026-09-16T09:32:50.019Z] [2026-09-16T09:32:50.019Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced _raw_params=./wait_server_drbd_sync.yml] *** [2026-09-16T09:32:50.433Z] skipping: [an-a01n01] [2026-09-16T09:32:50.433Z] skipping: [an-a01n02] [2026-09-16T09:32:50.433Z] [2026-09-16T09:32:50.433Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation _raw_params=./wait_server_ping.yml] *** [2026-09-16T09:32:50.433Z] skipping: [an-a01n01] [2026-09-16T09:32:50.433Z] skipping: [an-a01n02] [2026-09-16T09:32:50.433Z] [2026-09-16T09:32:50.433Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation _raw_params=./wait_server_ssh.yml] *** [2026-09-16T09:32:50.433Z] skipping: [an-a01n01] [2026-09-16T09:32:50.433Z] skipping: [an-a01n02] [2026-09-16T09:32:50.433Z] [2026-09-16T09:32:50.433Z] TASK [check if server an-test-deploy2 exists _raw_params=pcs status resources an-test-deploy{{ servernum }} [2026-09-16T09:32:50.433Z] ] *** [2026-09-16T09:32:53.109Z] skipping: [an-a01n02] [2026-09-16T09:32:53.109Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy2\n", "delta": "0:00:01.491262", "end": "2026-09-16 09:32:52.634667", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 09:32:51.143405", "stderr": "Error: resource or tag id 'an-test-deploy2' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy2' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T09:32:53.109Z] ...ignoring [2026-09-16T09:32:53.109Z] [2026-09-16T09:32:53.109Z] TASK [deploy server an-test-deploy2 from an-a01n01 on storage 9a2e8511-2f97-4cf0-a9d1-39bf305ffae2 _raw_params=anvil-provision-server -vv --log-secure \ [2026-09-16T09:32:53.109Z] --ci-test \ [2026-09-16T09:32:53.109Z] --name an-test-deploy{{ servernum }} \ [2026-09-16T09:32:53.109Z] --os almalinux9 \ [2026-09-16T09:32:53.109Z] --cpu 2 --ram 4G \ [2026-09-16T09:32:53.109Z] --storage-group {{ storageuuid }} --storage-size 10G \ [2026-09-16T09:32:53.109Z] --install-media {{ installisouuid }} \ [2026-09-16T09:32:53.109Z] --driver-disc deploy{{ servernum }}.iso [2026-09-16T09:32:53.109Z] ] *** [2026-09-16T09:33:04.926Z] skipping: [an-a01n02] [2026-09-16T09:33:04.926Z] changed: [an-a01n01] [2026-09-16T09:33:04.926Z] [2026-09-16T09:33:04.926Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker _raw_params=./wait_server_in_pacemaker.yml] *** [2026-09-16T09:33:04.926Z] skipping: [an-a01n01] [2026-09-16T09:33:04.926Z] skipping: [an-a01n02] [2026-09-16T09:33:04.926Z] [2026-09-16T09:33:04.926Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced _raw_params=./wait_server_drbd_sync.yml] *** [2026-09-16T09:33:04.926Z] skipping: [an-a01n01] [2026-09-16T09:33:04.926Z] skipping: [an-a01n02] [2026-09-16T09:33:04.926Z] [2026-09-16T09:33:04.926Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation _raw_params=./wait_server_ping.yml] *** [2026-09-16T09:33:04.926Z] skipping: [an-a01n01] [2026-09-16T09:33:04.926Z] skipping: [an-a01n02] [2026-09-16T09:33:04.926Z] [2026-09-16T09:33:04.926Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation _raw_params=./wait_server_ssh.yml] *** [2026-09-16T09:33:04.926Z] skipping: [an-a01n01] [2026-09-16T09:33:04.926Z] skipping: [an-a01n02] [2026-09-16T09:33:04.926Z] [2026-09-16T09:33:04.926Z] TASK [check if server an-test-deploy3 exists _raw_params=pcs status resources an-test-deploy{{ servernum }} [2026-09-16T09:33:04.926Z] ] *** [2026-09-16T09:33:05.336Z] skipping: [an-a01n02] [2026-09-16T09:33:05.336Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy3\n", "delta": "0:00:00.985625", "end": "2026-09-16 09:33:04.920238", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 09:33:03.934613", "stderr": "Error: resource or tag id 'an-test-deploy3' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy3' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T09:33:05.336Z] ...ignoring [2026-09-16T09:33:05.336Z] [2026-09-16T09:33:05.336Z] TASK [deploy server an-test-deploy3 from an-a01n01 on storage 9a2e8511-2f97-4cf0-a9d1-39bf305ffae2 _raw_params=anvil-provision-server -vv --log-secure \ [2026-09-16T09:33:05.336Z] --ci-test \ [2026-09-16T09:33:05.336Z] --name an-test-deploy{{ servernum }} \ [2026-09-16T09:33:05.336Z] --os almalinux9 \ [2026-09-16T09:33:05.336Z] --cpu 2 --ram 4G \ [2026-09-16T09:33:05.336Z] --storage-group {{ storageuuid }} --storage-size 10G \ [2026-09-16T09:33:05.336Z] --install-media {{ installisouuid }} \ [2026-09-16T09:33:05.336Z] --driver-disc deploy{{ servernum }}.iso [2026-09-16T09:33:05.336Z] ] *** [2026-09-16T09:33:17.163Z] skipping: [an-a01n02] [2026-09-16T09:33:17.163Z] changed: [an-a01n01] [2026-09-16T09:33:17.163Z] [2026-09-16T09:33:17.163Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker _raw_params=./wait_server_in_pacemaker.yml] *** [2026-09-16T09:33:17.163Z] skipping: [an-a01n01] [2026-09-16T09:33:17.163Z] skipping: [an-a01n02] [2026-09-16T09:33:17.163Z] [2026-09-16T09:33:17.163Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced _raw_params=./wait_server_drbd_sync.yml] *** [2026-09-16T09:33:17.163Z] skipping: [an-a01n01] [2026-09-16T09:33:17.163Z] skipping: [an-a01n02] [2026-09-16T09:33:17.163Z] [2026-09-16T09:33:17.163Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation _raw_params=./wait_server_ping.yml] *** [2026-09-16T09:33:17.163Z] skipping: [an-a01n01] [2026-09-16T09:33:17.163Z] skipping: [an-a01n02] [2026-09-16T09:33:17.163Z] [2026-09-16T09:33:17.163Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation _raw_params=./wait_server_ssh.yml] *** [2026-09-16T09:33:17.163Z] skipping: [an-a01n01] [2026-09-16T09:33:17.163Z] skipping: [an-a01n02] [2026-09-16T09:33:17.163Z] [2026-09-16T09:33:17.163Z] TASK [check if server an-test-deploy4 exists _raw_params=pcs status resources an-test-deploy{{ servernum }} [2026-09-16T09:33:17.163Z] ] *** [2026-09-16T09:33:19.840Z] skipping: [an-a01n02] [2026-09-16T09:33:19.840Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy4\n", "delta": "0:00:01.324650", "end": "2026-09-16 09:33:19.381879", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 09:33:18.057229", "stderr": "Error: resource or tag id 'an-test-deploy4' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy4' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T09:33:19.840Z] ...ignoring [2026-09-16T09:33:19.840Z] [2026-09-16T09:33:19.840Z] TASK [deploy server an-test-deploy4 from an-a01n01 on storage 9a2e8511-2f97-4cf0-a9d1-39bf305ffae2 _raw_params=anvil-provision-server -vv --log-secure \ [2026-09-16T09:33:19.840Z] --ci-test \ [2026-09-16T09:33:19.840Z] --name an-test-deploy{{ servernum }} \ [2026-09-16T09:33:19.840Z] --os almalinux9 \ [2026-09-16T09:33:19.840Z] --cpu 2 --ram 4G \ [2026-09-16T09:33:19.840Z] --storage-group {{ storageuuid }} --storage-size 10G \ [2026-09-16T09:33:19.840Z] --install-media {{ installisouuid }} \ [2026-09-16T09:33:19.840Z] --driver-disc deploy{{ servernum }}.iso [2026-09-16T09:33:19.840Z] ] *** [2026-09-16T09:33:31.672Z] skipping: [an-a01n02] [2026-09-16T09:33:31.672Z] changed: [an-a01n01] [2026-09-16T09:33:31.672Z] [2026-09-16T09:33:31.672Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker _raw_params=./wait_server_in_pacemaker.yml] *** [2026-09-16T09:33:31.672Z] skipping: [an-a01n01] [2026-09-16T09:33:31.672Z] skipping: [an-a01n02] [2026-09-16T09:33:31.672Z] [2026-09-16T09:33:31.672Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced _raw_params=./wait_server_drbd_sync.yml] *** [2026-09-16T09:33:31.672Z] skipping: [an-a01n01] [2026-09-16T09:33:31.672Z] skipping: [an-a01n02] [2026-09-16T09:33:31.672Z] [2026-09-16T09:33:31.672Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation _raw_params=./wait_server_ping.yml] *** [2026-09-16T09:33:32.085Z] skipping: [an-a01n01] [2026-09-16T09:33:32.085Z] skipping: [an-a01n02] [2026-09-16T09:33:32.085Z] [2026-09-16T09:33:32.085Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation _raw_params=./wait_server_ssh.yml] *** [2026-09-16T09:33:32.085Z] skipping: [an-a01n01] [2026-09-16T09:33:32.085Z] skipping: [an-a01n02] [2026-09-16T09:33:32.085Z] [2026-09-16T09:33:32.085Z] TASK [check if server an-test-deploy5 exists _raw_params=pcs status resources an-test-deploy{{ servernum }} [2026-09-16T09:33:32.085Z] ] *** [2026-09-16T09:33:34.762Z] skipping: [an-a01n02] [2026-09-16T09:33:34.762Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy5\n", "delta": "0:00:01.566723", "end": "2026-09-16 09:33:34.331582", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 09:33:32.764859", "stderr": "Error: resource or tag id 'an-test-deploy5' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy5' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T09:33:34.762Z] ...ignoring [2026-09-16T09:33:34.762Z] [2026-09-16T09:33:34.762Z] TASK [deploy server an-test-deploy5 from an-a01n01 on storage 9a2e8511-2f97-4cf0-a9d1-39bf305ffae2 _raw_params=anvil-provision-server -vv --log-secure \ [2026-09-16T09:33:34.762Z] --ci-test \ [2026-09-16T09:33:34.762Z] --name an-test-deploy{{ servernum }} \ [2026-09-16T09:33:34.762Z] --os almalinux9 \ [2026-09-16T09:33:34.762Z] --cpu 2 --ram 4G \ [2026-09-16T09:33:34.762Z] --storage-group {{ storageuuid }} --storage-size 10G \ [2026-09-16T09:33:34.762Z] --install-media {{ installisouuid }} \ [2026-09-16T09:33:34.762Z] --driver-disc deploy{{ servernum }}.iso [2026-09-16T09:33:34.762Z] ] *** [2026-09-16T09:33:46.582Z] skipping: [an-a01n02] [2026-09-16T09:33:46.582Z] changed: [an-a01n01] [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker _raw_params=./wait_server_in_pacemaker.yml] *** [2026-09-16T09:33:46.582Z] skipping: [an-a01n01] [2026-09-16T09:33:46.582Z] skipping: [an-a01n02] [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced _raw_params=./wait_server_drbd_sync.yml] *** [2026-09-16T09:33:46.582Z] skipping: [an-a01n01] [2026-09-16T09:33:46.582Z] skipping: [an-a01n02] [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation _raw_params=./wait_server_ping.yml] *** [2026-09-16T09:33:46.582Z] skipping: [an-a01n01] [2026-09-16T09:33:46.582Z] skipping: [an-a01n02] [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation _raw_params=./wait_server_ssh.yml] *** [2026-09-16T09:33:46.582Z] skipping: [an-a01n01] [2026-09-16T09:33:46.582Z] skipping: [an-a01n02] [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [wait servers to be started in pacemaker _raw_params=../../common/wait_server_in_pacemaker.yml] *** [2026-09-16T09:33:46.582Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=1) [2026-09-16T09:33:46.582Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=2) [2026-09-16T09:33:46.582Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=3) [2026-09-16T09:33:46.582Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=4) [2026-09-16T09:33:46.582Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=5) [2026-09-16T09:33:46.582Z] [2026-09-16T09:33:46.582Z] TASK [Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker _raw_params=pcs status resources an-test-deploy{{ servernum }} | grep Started [2026-09-16T09:33:46.582Z] ] *** [2026-09-16T09:34:15.780Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (360 retries left). [2026-09-16T09:34:15.780Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (360 retries left). [2026-09-16T09:34:15.780Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (359 retries left). [2026-09-16T09:34:15.780Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (359 retries left). [2026-09-16T09:34:15.780Z] ok: [an-a01n01] [2026-09-16T09:34:15.780Z] ok: [an-a01n02] [2026-09-16T09:34:15.780Z] [2026-09-16T09:34:15.780Z] TASK [Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker _raw_params=pcs status resources an-test-deploy{{ servernum }} | grep Started [2026-09-16T09:34:15.780Z] ] *** [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (360 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (360 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (359 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (359 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (358 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (358 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (357 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (357 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (356 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (356 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (355 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (355 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (354 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (354 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (353 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (353 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (352 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (352 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (351 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (351 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (350 retries left). [2026-09-16T09:36:41.392Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (350 retries left). [2026-09-16T09:36:41.392Z] ok: [an-a01n01] [2026-09-16T09:36:41.392Z] ok: [an-a01n02] [2026-09-16T09:36:41.392Z] [2026-09-16T09:36:41.392Z] TASK [Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker _raw_params=pcs status resources an-test-deploy{{ servernum }} | grep Started [2026-09-16T09:36:41.392Z] ] *** [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (360 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (360 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (359 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (359 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (358 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (358 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (357 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (357 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (356 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (356 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (355 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (355 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (354 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (354 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (353 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (353 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (352 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (352 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (351 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (351 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (350 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (350 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (349 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (349 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (348 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (348 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (347 retries left). [2026-09-16T09:39:37.387Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (347 retries left). [2026-09-16T09:39:37.387Z] ok: [an-a01n02] [2026-09-16T09:39:37.387Z] ok: [an-a01n01] [2026-09-16T09:39:37.387Z] [2026-09-16T09:39:37.387Z] TASK [Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker _raw_params=pcs status resources an-test-deploy{{ servernum }} | grep Started [2026-09-16T09:39:37.387Z] ] *** [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (360 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (360 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (359 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (359 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (358 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (358 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (357 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (357 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (356 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (356 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (355 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (355 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (354 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (354 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (353 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (353 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (352 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (352 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (351 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (351 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (350 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (350 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (349 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (349 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (348 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (348 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (347 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (347 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (346 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (346 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (345 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (345 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (344 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (344 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (343 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (343 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (342 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (342 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (341 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (341 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (340 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (340 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (339 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (339 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (338 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (338 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (337 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (337 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (336 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (336 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (335 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (335 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (334 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (334 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (333 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (333 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (332 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (332 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (331 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (331 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (330 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (330 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (329 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (329 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (328 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (328 retries left). [2026-09-16T09:46:05.655Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (327 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (327 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (326 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (326 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (325 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (325 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (324 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (324 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (323 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (323 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (322 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (322 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (321 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (321 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (320 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (320 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (319 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (319 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (318 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (318 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (317 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (317 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (316 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (316 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (315 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (315 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (314 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (314 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (313 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (313 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (312 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (312 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (311 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (311 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (310 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (310 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (309 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (309 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (308 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (308 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (307 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (307 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (306 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (306 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (305 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (305 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (304 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (304 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (303 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (303 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (302 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (302 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (301 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (301 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (300 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (300 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (299 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (299 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (298 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (298 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (297 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (297 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (296 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (296 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (295 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (295 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (294 retries left). [2026-09-16T09:52:49.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (294 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (293 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (293 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (292 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (292 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (291 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (291 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (290 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (290 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (289 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (289 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (288 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (288 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (287 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (287 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (286 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (286 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (285 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (285 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (284 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (284 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (283 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (283 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (282 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (282 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (281 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (281 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (280 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (280 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (279 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (279 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (278 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (278 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (277 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (277 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (276 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (276 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (275 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (275 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (274 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (274 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (273 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (273 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (272 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (272 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (271 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (271 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (270 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (270 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (269 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (269 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (268 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (268 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (267 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (267 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (266 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (266 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (265 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (265 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (264 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (264 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (263 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (263 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (262 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (262 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (261 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (261 retries left). [2026-09-16T09:59:32.466Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (260 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (260 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (259 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (259 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (258 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (258 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (257 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (257 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (256 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (256 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (255 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (255 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (254 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (254 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (253 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (253 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (252 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (252 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (251 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (251 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (250 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (250 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (249 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (249 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (248 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (248 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (247 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (247 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (246 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (246 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (245 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (245 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (244 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (244 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (243 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (243 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (242 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (242 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (241 retries left). [2026-09-16T10:06:00.761Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (241 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (240 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (240 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (239 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (239 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (238 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (238 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (237 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (237 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (236 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (236 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (235 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (235 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (234 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (234 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (233 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (233 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (232 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (232 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (231 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (231 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (230 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (230 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (229 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (229 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (228 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (228 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (227 retries left). [2026-09-16T10:06:00.762Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (227 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (226 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (225 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (226 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (224 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (225 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (223 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (224 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (222 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (223 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (221 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (222 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (220 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (221 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (219 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (220 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (218 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (219 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (217 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (218 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (216 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (217 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (215 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (216 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (214 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (215 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (213 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (214 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (212 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (213 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (211 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (212 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (210 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (211 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (209 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (210 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (208 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (209 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (207 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (208 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (206 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (207 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (205 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (206 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (204 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (205 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (203 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (204 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (202 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (203 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (201 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (202 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (200 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (201 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (199 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (198 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (200 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (197 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (199 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (196 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (198 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (195 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (197 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (194 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (196 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (193 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (195 retries left). [2026-09-16T10:12:44.823Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (192 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (194 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (191 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (193 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (190 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (192 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (189 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (191 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (188 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (190 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (187 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (189 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (186 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (188 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (185 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (187 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (184 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (186 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (183 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (185 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (182 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (184 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (181 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (183 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (180 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (182 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (179 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (181 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (178 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (180 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (177 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (179 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (176 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (178 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (175 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (177 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (174 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (176 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (173 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (175 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (172 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (174 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (171 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (173 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (170 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (172 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (169 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (171 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (168 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (170 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (167 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (169 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (166 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (168 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (165 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (167 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (164 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (166 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (163 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (165 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (162 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (164 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (161 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (163 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (160 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (162 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (159 retries left). [2026-09-16T10:19:28.308Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (161 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (158 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (160 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (157 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (159 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (156 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (158 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (155 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (157 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (154 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (156 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (153 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (155 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (152 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (154 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (151 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (153 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (150 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (152 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (149 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (151 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (148 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (150 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (147 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (149 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (146 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (148 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (145 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (147 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (144 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (146 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (143 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (145 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (142 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (144 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (141 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (143 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (140 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (142 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (139 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (141 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (138 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (140 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (137 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (139 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (136 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (135 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (138 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (134 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (137 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (136 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (133 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (132 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (135 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (131 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (134 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (130 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (133 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (129 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (132 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (128 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (131 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (127 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (130 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (126 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (129 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (125 retries left). [2026-09-16T10:26:11.814Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (128 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (124 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (127 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (123 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (126 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (122 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (125 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (121 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (124 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (120 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (123 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (119 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (122 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (118 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (121 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (117 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (120 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (116 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (119 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (115 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (118 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (114 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (117 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (113 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (116 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (112 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (115 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (111 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (114 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (110 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (113 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (109 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (112 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (108 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (111 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (107 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (110 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (106 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (109 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (105 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (108 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (104 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (107 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (103 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (106 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (102 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (105 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (101 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (104 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (100 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (103 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (99 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (102 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (98 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (101 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (97 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (96 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (100 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (95 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (99 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (94 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (98 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (93 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (97 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (92 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (96 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (91 retries left). [2026-09-16T10:32:40.094Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (95 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (90 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (94 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (89 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (93 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (88 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (92 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (87 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (91 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (86 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (90 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (85 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (89 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (84 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (88 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (83 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (87 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (82 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (86 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (81 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (85 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (80 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (84 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (79 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (83 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (78 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (82 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (77 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (81 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (76 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (80 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (75 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (79 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (74 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (78 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (73 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (77 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (72 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (76 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (71 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (75 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (70 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (74 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (69 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (73 retries left). [2026-09-16T10:39:23.591Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (68 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (72 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (67 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (71 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (66 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (70 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (65 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (69 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (64 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (68 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (63 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (67 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (62 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (66 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (61 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (65 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (60 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (64 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (59 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (63 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (58 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (62 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (57 retries left). [2026-09-16T10:39:23.592Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (61 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (56 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (60 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (55 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (59 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (54 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (58 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (53 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (57 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (52 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (56 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (51 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (55 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (50 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (54 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (49 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (53 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (48 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (52 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (47 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (51 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (46 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (50 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (45 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (49 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (44 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (48 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (43 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (47 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (42 retries left). [2026-09-16T10:46:07.070Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (41 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (46 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (40 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (45 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (39 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (44 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (38 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (43 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (37 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (42 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (36 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (41 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (35 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (40 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (34 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (39 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (33 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (38 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (32 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (37 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (31 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (36 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (30 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (35 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (29 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (34 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (28 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (33 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (27 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (32 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (26 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (31 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (25 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (30 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (24 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (29 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (23 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (28 retries left). [2026-09-16T10:46:07.071Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (22 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (27 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (21 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (26 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (20 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (25 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (19 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (24 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (18 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (23 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (17 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (22 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (16 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (21 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (15 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (20 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (14 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (19 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (13 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (18 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (12 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (17 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (11 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (16 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (10 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (15 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (9 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (14 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (8 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (13 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (7 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (12 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (6 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (11 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (5 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (10 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (4 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (9 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (3 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (8 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (2 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (7 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (1 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (6 retries left). [2026-09-16T10:51:34.985Z] fatal: [an-a01n02]: FAILED! => {"attempts": 360, "changed": false, "cmd": "pcs status resources an-test-deploy4 | grep Started\n", "delta": "0:00:00.955031", "end": "2026-09-16 10:50:19.719457", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 10:50:18.764426", "stderr": "Error: resource or tag id 'an-test-deploy4' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy4' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (5 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (4 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (3 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (2 retries left). [2026-09-16T10:51:34.985Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (1 retries left). [2026-09-16T10:51:34.985Z] fatal: [an-a01n01]: FAILED! => {"attempts": 360, "changed": false, "cmd": "pcs status resources an-test-deploy4 | grep Started\n", "delta": "0:00:01.995599", "end": "2026-09-16 10:51:32.840514", "msg": "non-zero return code", "rc": 1, "start": "2026-09-16 10:51:30.844915", "stderr": "Error: resource or tag id 'an-test-deploy4' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy4' not found"], "stdout": "", "stdout_lines": []} [2026-09-16T10:51:34.985Z] [2026-09-16T10:51:34.985Z] NO MORE HOSTS LEFT ************************************************************* [2026-09-16T10:51:34.985Z] [2026-09-16T10:51:34.985Z] PLAY RECAP ********************************************************************* [2026-09-16T10:51:34.985Z] an-a01n01 : ok=64 changed=12 unreachable=0 failed=1 skipped=27 rescued=0 ignored=5 [2026-09-16T10:51:34.985Z] an-a01n02 : ok=54 changed=7 unreachable=0 failed=1 skipped=37 rescued=0 ignored=0 [2026-09-16T10:51:34.985Z] an-striker01 : ok=37 changed=11 unreachable=0 failed=0 skipped=3 rescued=0 ignored=0 [2026-09-16T10:51:34.985Z] an-striker02 : ok=27 changed=6 unreachable=0 failed=0 skipped=3 rescued=0 ignored=0 [2026-09-16T10:51:34.985Z] [2026-09-16T10:51:34.985Z] tar: Removing leading `/' from member names [2026-09-16T10:51:34.985Z] tar: /tmp/simengine/5/snmpsimd.log: file changed as we read it [2026-09-16T10:51:39.355Z] Data collection has begun. This will take a while! [2026-09-16T10:51:39.355Z] [2026-09-16T10:51:39.355Z] Preparing local machine [2026-09-16T10:51:39.355Z] - Output directory [/root] already exists. [2026-09-16T10:51:39.355Z] - Creating temporary data dir [/tmp/anvil-debug_2026-09-16_10-51-39]... Done! [2026-09-16T10:51:39.355Z] [2026-09-16T10:51:39.355Z] Grabbing logs and data from the local system. [2026-09-16T10:51:39.355Z] - Grabbing system logs from the previous boot... Done! [2026-09-16T10:51:40.229Z] - Grabbing system logs from this boot... Done! [2026-09-16T10:51:41.625Z] - Dumping and compressing database data, PLEASE BE PATIENT!... Done! [2026-09-16T10:51:41.625Z] - Screehshots collection disabled. [2026-09-16T10:51:41.625Z] - Grabbing hosts file... Done! [2026-09-16T10:51:41.625Z] - Grabbing Anvil! config... Done! [2026-09-16T10:51:43.619Z] - Grabbing Anvil! log... Done! [2026-09-16T10:51:43.619Z] - Grabbing cloud-init logs... Done! [2026-09-16T10:51:43.619Z] [2026-09-16T10:51:43.619Z] Grabbing logs and data from the remote system: [an-striker02]. [2026-09-16T10:51:43.619Z] - Testing access... [2026-09-16T10:51:44.031Z] - Found access over the network: [bcn1] using the target IP: [10.201.4.2] [2026-09-16T10:51:48.948Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.3] [2026-09-16T10:51:48.948Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T10:51:48.948Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T10:51:49.829Z] - Grabbing cloud-init logs... Done. [2026-09-16T10:51:51.246Z] - Dumping and compressing remote database data, PLEASE BE PATIENT!... Done! [2026-09-16T10:51:52.092Z] - Grabbing hosts file... Done. [2026-09-16T10:52:13.111Z] - Grabbing Anvil! log... Done. [2026-09-16T10:52:13.524Z] - Grabbing audit logs... Done. [2026-09-16T10:52:13.939Z] - Grabbing Anvil! config... Done. [2026-09-16T10:52:13.939Z] [2026-09-16T10:52:13.939Z] Grabbing logs and data from the remote system: [an-a01n01]. [2026-09-16T10:52:13.939Z] - Testing access... [2026-09-16T10:52:14.356Z] - Found access over the network: [bcn1] using the target IP: [10.201.10.1] [2026-09-16T10:52:14.771Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.4] [2026-09-16T10:52:16.073Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T10:52:18.349Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T10:52:18.764Z] - Grabbing cloud-init logs... Done. [2026-09-16T10:52:19.642Z] - Grabbing hosts file... Done. [2026-09-16T10:53:01.297Z] - Grabbing Anvil! log... Done. [2026-09-16T10:53:01.710Z] - Grabbing audit logs... Done. [2026-09-16T10:53:02.122Z] - Grabbing Anvil! config... Done. [2026-09-16T10:53:03.408Z] - Collecting the cluster information base (CIB)... Done! Copying to here... Done. [2026-09-16T10:53:03.820Z] - Collecting the corosync config... Done. [2026-09-16T10:53:04.232Z] - Collecting server definitions... Done! [2026-09-16T10:53:04.643Z] - Collecting replicated storage config... Done! [2026-09-16T10:53:04.643Z] [2026-09-16T10:53:04.643Z] Grabbing logs and data from the remote system: [an-a01n02]. [2026-09-16T10:53:04.643Z] - Testing access... [2026-09-16T10:53:05.517Z] - Found access over the network: [bcn1] using the target IP: [10.201.10.2] [2026-09-16T10:53:05.930Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.5] [2026-09-16T10:53:06.760Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T10:53:07.591Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T10:53:08.006Z] - Grabbing cloud-init logs... Done. [2026-09-16T10:53:08.419Z] - Grabbing hosts file... Done. [2026-09-16T10:53:50.062Z] - Grabbing Anvil! log... Done. [2026-09-16T10:53:50.062Z] - Grabbing audit logs... Done. [2026-09-16T10:53:50.062Z] - Grabbing Anvil! config... Done. [2026-09-16T10:53:51.461Z] - Collecting the cluster information base (CIB)... Done! Copying to here... Done. [2026-09-16T10:53:51.872Z] - Collecting the corosync config... Done. [2026-09-16T10:53:52.283Z] - Collecting server definitions... Done! [2026-09-16T10:53:52.695Z] - Collecting replicated storage config... Done! [2026-09-16T10:53:52.695Z] [2026-09-16T10:53:52.695Z] Data collection complete [2026-09-16T11:16:16.371Z] - Creating the tarball now. PLEASE BE PATIENT!... Done! [2026-09-16T11:16:16.371Z] - Removing temporary data dir [/tmp/anvil-debug_2026-09-16_10-51-39]... Done! [2026-09-16T11:16:16.371Z] [2026-09-16T11:16:16.371Z] [ Complete ] - The debug data collected here: [/root/debug.tar.bz2] [2026-09-16T11:16:16.371Z] [ Warning ] - The collected data and logs likely include sensitive information! Share it carefully! [2026-09-16T11:16:28.214Z] Data collection has begun. This will take a while! [2026-09-16T11:16:28.214Z] [2026-09-16T11:16:28.214Z] Preparing local machine [2026-09-16T11:16:28.214Z] - Output directory [/root] already exists. [2026-09-16T11:16:28.214Z] - Creating temporary data dir [/tmp/anvil-debug_2026-09-16_11-16-26]... Done! [2026-09-16T11:16:28.214Z] [2026-09-16T11:16:28.214Z] Grabbing logs and data from the remote system: [an-striker01]. [2026-09-16T11:16:28.214Z] - Testing access... [2026-09-16T11:16:28.214Z] - Found access over the network: [bcn1] using the target IP: [10.201.4.1] [2026-09-16T11:16:28.626Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.2] [2026-09-16T11:16:29.452Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T11:16:31.209Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T11:16:32.037Z] - Grabbing cloud-init logs... Done. [2026-09-16T11:16:34.027Z] - Dumping and compressing remote database data, PLEASE BE PATIENT!... Done! [2026-09-16T11:16:34.441Z] - Grabbing hosts file... Done. [2026-09-16T11:17:03.656Z] - Grabbing Anvil! log... Done. [2026-09-16T11:17:03.656Z] - Grabbing audit logs... Done. [2026-09-16T11:17:03.656Z] - Grabbing Anvil! config... Done. [2026-09-16T11:17:03.656Z] [2026-09-16T11:17:03.656Z] Grabbing logs and data from the local system. [2026-09-16T11:17:03.656Z] - Grabbing system logs from the previous boot... Done! [2026-09-16T11:17:03.656Z] - Grabbing system logs from this boot... Done! [2026-09-16T11:17:05.053Z] - Dumping and compressing database data, PLEASE BE PATIENT!... Done! [2026-09-16T11:17:05.053Z] - Screehshots collection disabled. [2026-09-16T11:17:05.053Z] - Grabbing hosts file... Done! [2026-09-16T11:17:05.053Z] - Grabbing Anvil! config... Done! [2026-09-16T11:17:07.725Z] - Grabbing Anvil! log... Done! [2026-09-16T11:17:07.725Z] - Grabbing cloud-init logs... Done! [2026-09-16T11:17:07.725Z] [2026-09-16T11:17:07.725Z] Grabbing logs and data from the remote system: [an-a01n01]. [2026-09-16T11:17:07.725Z] - Testing access... [2026-09-16T11:17:08.140Z] - Found access over the network: [bcn1] using the target IP: [10.201.10.1] [2026-09-16T11:17:09.018Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.4] [2026-09-16T11:17:09.843Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T11:17:13.401Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T11:17:13.816Z] - Grabbing cloud-init logs... Done. [2026-09-16T11:17:14.232Z] - Grabbing hosts file... Done. [2026-09-16T11:18:25.332Z] - Grabbing Anvil! log... Done. [2026-09-16T11:18:25.332Z] - Grabbing audit logs... Done. [2026-09-16T11:18:25.332Z] - Grabbing Anvil! config... Done. [2026-09-16T11:18:25.332Z] - Collecting the cluster information base (CIB)... Done! Copying to here... Done. [2026-09-16T11:18:25.332Z] - Collecting the corosync config... Done. [2026-09-16T11:18:25.332Z] - Collecting server definitions... Done! [2026-09-16T11:18:25.332Z] - Collecting replicated storage config... Done! [2026-09-16T11:18:25.332Z] [2026-09-16T11:18:25.332Z] Grabbing logs and data from the remote system: [an-a01n02]. [2026-09-16T11:18:25.332Z] - Testing access... [2026-09-16T11:18:25.332Z] - Found access over the network: [bcn1] using the target IP: [10.201.10.2] [2026-09-16T11:18:25.332Z] - Found access over the network: [ifn1] using the target IP: [192.168.122.5] [2026-09-16T11:18:25.332Z] - Writing out system logs from the previous boot... Done! Copying to here... Done. [2026-09-16T11:18:25.332Z] - Grabbing system logs from this boot... Done! Copying to here... Done. [2026-09-16T11:18:25.332Z] - Grabbing cloud-init logs... Done. [2026-09-16T11:18:25.332Z] - Grabbing hosts file... Done. [2026-09-16T11:19:15.129Z] - Grabbing Anvil! log... Done. [2026-09-16T11:19:15.129Z] - Grabbing audit logs... Done. [2026-09-16T11:19:15.129Z] - Grabbing Anvil! config... Done. [2026-09-16T11:19:16.420Z] - Collecting the cluster information base (CIB)... Done! Copying to here... Done. [2026-09-16T11:19:16.833Z] - Collecting the corosync config... Done. [2026-09-16T11:19:17.246Z] - Collecting server definitions... Done! [2026-09-16T11:19:17.660Z] - Collecting replicated storage config... Done! [2026-09-16T11:19:17.660Z] [2026-09-16T11:19:17.660Z] Data collection complete [2026-09-16T11:53:18.883Z] - Creating the tarball now. PLEASE BE PATIENT!... Done! [2026-09-16T11:53:18.883Z] - Removing temporary data dir [/tmp/anvil-debug_2026-09-16_11-16-26]... Done! [2026-09-16T11:53:18.883Z] [2026-09-16T11:53:18.883Z] [ Complete ] - The debug data collected here: [/root/debug.tar.bz2] [2026-09-16T11:53:18.883Z] [ Warning ] - The collected data and logs likely include sensitive information! Share it carefully! [2026-09-16T11:53:25.539Z] Will stop any running daemons ('--disable --now' used) after disabling daemons. [2026-09-16T11:53:25.539Z] Disabling: [anvil-daemon] now... [2026-09-16T11:53:25.539Z] Stopping: [anvil-daemon] now... [2026-09-16T11:53:25.539Z] Disabling: [anvil-monitor-network] now... [2026-09-16T11:53:25.950Z] Stopping: [anvil-monitor-network] now... [2026-09-16T11:53:25.950Z] Disabling: [scancore] now... [2026-09-16T11:53:26.361Z] Stopping: [scancore] now... [2026-09-16T11:53:26.361Z] Disabling: [striker-ui-api] now... [2026-09-16T11:53:26.775Z] Stopping: [striker-ui-api] now... [2026-09-16T11:53:27.189Z] Done. [2026-09-16T11:53:27.189Z] [2026-09-16T11:53:29.187Z] Anvil! Intelligent Availability Daemon Status (Enabled, Started, Failed); [2026-09-16T11:53:29.187Z] Daemons [enabled/started/failed]; anvil-daemon [Disabled/Stopped/OK], anvil-monitor-daemons [Disabled/Stopped/OK], anvil-monitor-network [Disabled/Stopped/OK], anvil-monitor-performance [Disabled/Stopped/OK], scancore [Disabled/Stopped/OK], striker-ui-api [Disabled/Stopped/OK]. [2026-09-16T11:53:31.185Z] Will stop any running daemons ('--disable --now' used) after disabling daemons. [2026-09-16T11:53:31.185Z] Disabling: [anvil-daemon] now... [2026-09-16T11:53:31.599Z] Stopping: [anvil-daemon] now... [2026-09-16T11:53:31.599Z] Disabling: [anvil-monitor-network] now... [2026-09-16T11:53:32.012Z] Stopping: [anvil-monitor-network] now... [2026-09-16T11:53:32.012Z] Disabling: [scancore] now... [2026-09-16T11:53:32.426Z] Stopping: [scancore] now... [2026-09-16T11:53:32.426Z] Disabling: [striker-ui-api] now... [2026-09-16T11:53:33.303Z] Stopping: [striker-ui-api] now... [2026-09-16T11:53:33.303Z] Done. [2026-09-16T11:53:33.303Z] [2026-09-16T11:53:35.302Z] Anvil! Intelligent Availability Daemon Status (Enabled, Started, Failed); [2026-09-16T11:53:35.302Z] Daemons [enabled/started/failed]; anvil-daemon [Disabled/Stopped/OK], anvil-monitor-daemons [Disabled/Stopped/OK], anvil-monitor-network [Disabled/Stopped/OK], anvil-monitor-performance [Disabled/Stopped/OK], scancore [Disabled/Stopped/OK], striker-ui-api [Disabled/Stopped/OK]. [2026-09-16T11:53:37.977Z] Will stop any running daemons ('--disable --now' used) after disabling daemons. [2026-09-16T11:53:37.977Z] Disabling: [anvil-daemon] now... [2026-09-16T11:53:38.853Z] Stopping: [anvil-daemon] now... [2026-09-16T11:53:40.849Z] Disabling: [anvil-monitor-network] now... [2026-09-16T11:53:41.726Z] Stopping: [anvil-monitor-network] now... [2026-09-16T11:53:41.726Z] Disabling: [anvil-safe-start] now... [2026-09-16T11:53:42.605Z] Stopping: [anvil-safe-start] now... [2026-09-16T11:53:42.605Z] Disabling: [scancore] now... [2026-09-16T11:53:43.482Z] Stopping: [scancore] now... [2026-09-16T11:53:43.482Z] Done. [2026-09-16T11:53:43.482Z] [2026-09-16T11:53:45.477Z] Anvil! Intelligent Availability Daemon Status (Enabled, Started, Failed); [2026-09-16T11:53:45.477Z] Daemons [enabled/started/failed]; anvil-daemon [Disabled/Stopped/Failed!], anvil-monitor-daemons [Disabled/Stopped/OK], anvil-monitor-network [Disabled/Stopped/OK], anvil-monitor-performance [Disabled/Stopped/OK], anvil-safe-start [Disabled/Stopped/OK], scancore [Disabled/Stopped/OK]. [2026-09-16T11:53:48.159Z] Will stop any running daemons ('--disable --now' used) after disabling daemons. [2026-09-16T11:53:48.159Z] Disabling: [anvil-daemon] now... [2026-09-16T11:53:48.572Z] Stopping: [anvil-daemon] now... [2026-09-16T11:53:48.572Z] Disabling: [anvil-monitor-network] now... [2026-09-16T11:53:48.986Z] Stopping: [anvil-monitor-network] now... [2026-09-16T11:53:49.400Z] Disabling: [anvil-safe-start] now... [2026-09-16T11:53:50.277Z] Stopping: [anvil-safe-start] now... [2026-09-16T11:53:50.277Z] Disabling: [scancore] now... [2026-09-16T11:53:50.277Z] Stopping: [scancore] now... [2026-09-16T11:53:50.690Z] Done. [2026-09-16T11:53:50.690Z] [2026-09-16T11:53:52.091Z] Anvil! Intelligent Availability Daemon Status (Enabled, Started, Failed); [2026-09-16T11:53:52.091Z] Daemons [enabled/started/failed]; anvil-daemon [Disabled/Stopped/OK], anvil-monitor-daemons [Disabled/Stopped/OK], anvil-monitor-network [Disabled/Stopped/OK], anvil-monitor-performance [Disabled/Stopped/OK], anvil-safe-start [Disabled/Stopped/OK], scancore [Disabled/Stopped/OK]. [2026-09-16T11:53:55.553Z] Will stop any running daemons ('--disable --now' used) after disabling daemons. [2026-09-16T11:53:55.553Z] Disabling: [anvil-daemon] now... [2026-09-16T11:53:55.967Z] Stopping: [anvil-daemon] now... [2026-09-16T11:53:55.967Z] Disabling: [anvil-monitor-network] now... [2026-09-16T11:53:56.842Z] Stopping: [anvil-monitor-network] now... [2026-09-16T11:53:56.842Z] Disabling: [scancore] now... [2026-09-16T11:53:57.718Z] Stopping: [scancore] now... [2026-09-16T11:53:57.718Z] Done. [2026-09-16T11:53:57.718Z] [2026-09-16T11:53:59.120Z] Anvil! Intelligent Availability Daemon Status (Enabled, Started, Failed); [2026-09-16T11:53:59.120Z] Daemons [enabled/started/failed]; anvil-daemon [Disabled/Stopped/OK], anvil-monitor-daemons [Disabled/Stopped/OK], anvil-monitor-network [Disabled/Stopped/OK], anvil-monitor-performance [Disabled/Stopped/OK], anvil-safe-start [Disabled/Stopped/OK], scancore [Disabled/Stopped/OK]. [2026-09-16T11:54:23.776Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts. [2026-09-16T11:54:27.457Z] /root/ci-tools [2026-09-16T11:54:27.870Z] Complete anvil logs available here for download: http://anvil-ci-repo.ci.alteeve.com/testing-logs/1205.tar.gz [2026-09-16T11:54:27.994Z] [Pipeline] } [2026-09-16T11:54:27.997Z] [Pipeline] // timeout [2026-09-16T11:54:27.999Z] [Pipeline] echo [2026-09-16T11:54:28.000Z] runWithTimeout caught AbortException hudson.AbortException: script returned exit code 2 [2026-09-16T11:54:28.000Z] [Pipeline] echo [2026-09-16T11:54:28.000Z] runWithTimeout: script exit non-zero [2026-09-16T11:54:28.004Z] [Pipeline] echo [2026-09-16T11:54:28.004Z] RC runWithTimeout returned ERROR [2026-09-16T11:54:28.015Z] [Pipeline] sh [2026-09-16T11:54:28.814Z] [Pipeline] } [2026-09-16T11:54:28.817Z] [Pipeline] // script [2026-09-16T11:54:28.821Z] [Pipeline] } [2026-09-16T11:54:28.823Z] [Pipeline] // stage [2026-09-16T11:54:28.827Z] [Pipeline] stage [2026-09-16T11:54:28.827Z] [Pipeline] { (Declarative: Post Actions) [2026-09-16T11:54:28.859Z] [Pipeline] cleanWs [2026-09-16T11:54:28.944Z] [WS-CLEANUP] Deleting project workspace... [2026-09-16T11:54:28.944Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [2026-09-16T11:54:28.986Z] [WS-CLEANUP] done [2026-09-16T11:54:28.991Z] [Pipeline] script [2026-09-16T11:54:28.993Z] [Pipeline] { [2026-09-16T11:54:29.008Z] [Pipeline] stage [2026-09-16T11:54:29.008Z] [Pipeline] { (Copying logs) [2026-09-16T11:54:29.069Z] [Pipeline] node [2026-09-16T11:54:29.172Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing [2026-09-16T11:54:29.173Z] [Pipeline] { [2026-09-16T11:54:29.211Z] [Pipeline] node [2026-09-16T11:54:29.312Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@2 [2026-09-16T11:54:29.313Z] [Pipeline] { [2026-09-16T11:54:29.317Z] [Pipeline] sh [2026-09-16T11:54:29.572Z] + mkdir -p /var/lib/jenkins/locks [2026-09-16T11:54:29.581Z] [Pipeline] echo [2026-09-16T11:54:29.582Z] RWLock: FD for lock log_archive in stage projectFinishUp is 98 [2026-09-16T11:54:29.585Z] [Pipeline] sleep [2026-09-16T11:54:29.585Z] No need to sleep any longer [2026-09-16T11:54:29.587Z] [Pipeline] echo [2026-09-16T11:54:29.587Z] RWLock: log_archive in stage projectFinishUp locked for WRITE [2026-09-16T11:54:29.590Z] [Pipeline] } [2026-09-16T11:54:29.592Z] [Pipeline] // node [2026-09-16T11:54:29.596Z] [Pipeline] echo [2026-09-16T11:54:29.596Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-functional-testing/1205/ [2026-09-16T11:54:29.597Z] [Pipeline] sh [2026-09-16T11:54:29.851Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-functional-testing/1205/ [2026-09-16T11:54:29.853Z] [Pipeline] sh