[2026-04-16T01:18:42.655Z] Started by upstream project "anvil/anvil-pipeline/PR-999" build number 24
[2026-04-16T01:18:42.655Z] originally caused by:
[2026-04-16T01:18:42.655Z]  GitHub pull request comment by digimer: retest this please (https://github.com/ClusterLabs/anvil/pull/999#issuecomment-4256601980)
[2026-04-16T01:18:42.976Z] Obtained pipelines/projects/anvil/build-functional-testing/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-04-16T01:18:42.986Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-04-16T01:18:43.430Z] Examining kronosnet/ci-tools
[2026-04-16T01:18:43.430Z] Attempting to resolve main as a branch
[2026-04-16T01:18:43.637Z] Resolved main as branch main at revision 73ed6275b1ab90dc4db382514cbc5070a56e2e90
[2026-04-16T01:18:43.637Z] Selected Git installation does not exist. Using Default
[2026-04-16T01:18:43.637Z] The recommended git tool is: NONE
[2026-04-16T01:18:43.637Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-16T01:18:43.640Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-16T01:18:43.640Z] Wiping out workspace first.
[2026-04-16T01:18:43.662Z] Cloning the remote Git repository
[2026-04-16T01:18:43.662Z] Using shallow clone with depth 1
[2026-04-16T01:18:43.662Z] Avoid fetching tags
[2026-04-16T01:18:43.662Z] Honoring refspec on initial clone
[2026-04-16T01:18:43.662Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-16T01:18:43.662Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-04-16T01:18:43.671Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-16T01:18:43.672Z]  > git --version # timeout=10
[2026-04-16T01:18:43.678Z]  > git --version # 'git version 2.47.3'
[2026-04-16T01:18:43.678Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-16T01:18:43.685Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-16T01:18:43.879Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-16T01:18:43.887Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-16T01:18:43.895Z] Avoid second fetch
[2026-04-16T01:18:43.895Z] Checking out Revision 73ed6275b1ab90dc4db382514cbc5070a56e2e90 (main)
[2026-04-16T01:18:43.895Z]  > git config core.sparsecheckout # timeout=10
[2026-04-16T01:18:43.902Z]  > git checkout -f 73ed6275b1ab90dc4db382514cbc5070a56e2e90 # timeout=10
[2026-04-16T01:18:43.935Z] Commit message: "Revert "New getUpNodesByLabel() call""
[2026-04-16T01:18:43.942Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-04-16T01:18:44.112Z] Examining kronosnet/ci-tools
[2026-04-16T01:18:44.112Z] Attempting to resolve main as a branch
[2026-04-16T01:18:44.252Z] Resolved main as branch main at revision 73ed6275b1ab90dc4db382514cbc5070a56e2e90
[2026-04-16T01:18:44.252Z] Selected Git installation does not exist. Using Default
[2026-04-16T01:18:44.252Z] The recommended git tool is: NONE
[2026-04-16T01:18:44.253Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-16T01:18:44.257Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-16T01:18:44.257Z] Wiping out workspace first.
[2026-04-16T01:18:44.279Z] Cloning the remote Git repository
[2026-04-16T01:18:44.279Z] Using shallow clone with depth 1
[2026-04-16T01:18:44.279Z] Avoid fetching tags
[2026-04-16T01:18:44.279Z] Honoring refspec on initial clone
[2026-04-16T01:18:44.279Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-16T01:18:44.279Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-04-16T01:18:44.289Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-16T01:18:44.289Z]  > git --version # timeout=10
[2026-04-16T01:18:44.297Z]  > git --version # 'git version 2.47.3'
[2026-04-16T01:18:44.297Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-16T01:18:44.303Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-16T01:18:44.470Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-16T01:18:44.477Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-16T01:18:44.484Z] Avoid second fetch
[2026-04-16T01:18:44.485Z] Checking out Revision 73ed6275b1ab90dc4db382514cbc5070a56e2e90 (main)
[2026-04-16T01:18:44.485Z]  > git config core.sparsecheckout # timeout=10
[2026-04-16T01:18:44.493Z]  > git checkout -f 73ed6275b1ab90dc4db382514cbc5070a56e2e90 # timeout=10
[2026-04-16T01:18:44.524Z] Commit message: "Revert "New getUpNodesByLabel() call""
[2026-04-16T01:18:44.639Z] [Pipeline] Start of Pipeline
[2026-04-16T01:18:44.772Z] [Pipeline] node
[2026-04-16T01:18:44.775Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-functional-testing
[2026-04-16T01:18:44.776Z] [Pipeline] {
[2026-04-16T01:18:44.785Z] [Pipeline] stage
[2026-04-16T01:18:44.785Z] [Pipeline] { (Prep build env)
[2026-04-16T01:18:44.796Z] [Pipeline] script
[2026-04-16T01:18:44.798Z] [Pipeline] {
[2026-04-16T01:18:44.812Z] [Pipeline] cleanWs
[2026-04-16T01:18:44.874Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-16T01:18:44.875Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-16T01:18:44.909Z] [WS-CLEANUP] done
[2026-04-16T01:18:44.936Z] [Pipeline] lock
[2026-04-16T01:18:44.936Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-04-16T01:18:44.936Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-04-16T01:18:44.936Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-04-16T01:18:44.937Z] [Pipeline] {
[2026-04-16T01:18:44.939Z] [Pipeline] }
[2026-04-16T01:18:44.940Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-04-16T01:18:44.942Z] [Pipeline] // lock
[2026-04-16T01:18:44.947Z] [Pipeline] }
[2026-04-16T01:18:44.949Z] [Pipeline] // script
[2026-04-16T01:18:44.952Z] [Pipeline] }
[2026-04-16T01:18:44.954Z] [Pipeline] // stage
[2026-04-16T01:18:44.958Z] [Pipeline] stage
[2026-04-16T01:18:44.958Z] [Pipeline] { (Run functional testing)
[2026-04-16T01:18:44.967Z] [Pipeline] script
[2026-04-16T01:18:44.968Z] [Pipeline] {
[2026-04-16T01:18:44.987Z] [Pipeline] echo
[2026-04-16T01:18:44.987Z] runWithTimeout 360
[2026-04-16T01:18:44.988Z] [Pipeline] timeout
[2026-04-16T01:18:44.988Z] Timeout set to expire in 6 hr 0 min
[2026-04-16T01:18:44.989Z] [Pipeline] {
[2026-04-16T01:18:44.993Z] [Pipeline] sh
[2026-04-16T01:18:45.520Z] + /root/ci-tools/ci-wrap ci-setup-anvil-bm-vm rhel-9 enterprise-staging pr/999 all
[2026-04-16T01:18:45.520Z] CITBRANCH:  main
[2026-04-16T01:18:45.520Z] CITHOME:    /root/ci-tools
[2026-04-16T01:18:45.520Z] CITCMD:     ci-setup-anvil-bm-vm
[2026-04-16T01:18:45.520Z] CITCMDARGS: rhel-9 enterprise-staging pr/999 all
[2026-04-16T01:18:45.889Z] Genering ssh keys and ssh config
[2026-04-16T01:18:45.889Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:18:46.257Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:18:46.257Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:18:46.257Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:18:46.257Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:18:46.627Z] Delay build by 180 seconds to allow Jenkins to cancel the job
[2026-04-16T01:21:58.297Z] Destroying VMs (if any)
[2026-04-16T01:21:58.297Z] Warning: Permanently added 'an-striker01' (ED25519) to the list of known hosts.
[2026-04-16T01:21:58.297Z] bash: line 1: rhc: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: insights-client: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: subscription-manager: command not found
[2026-04-16T01:21:58.297Z] Domain 'an-striker01' destroyed
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Domain 'an-striker01' has been undefined
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Warning: Permanently added 'an-striker02' (ED25519) to the list of known hosts.
[2026-04-16T01:21:58.297Z] bash: line 1: rhc: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: insights-client: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: subscription-manager: command not found
[2026-04-16T01:21:58.297Z] Domain 'an-striker02' destroyed
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Domain 'an-striker02' has been undefined
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Warning: Permanently added 'an-a01n01' (ED25519) to the list of known hosts.
[2026-04-16T01:21:58.297Z] bash: line 1: rhc: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: insights-client: command not found
[2026-04-16T01:21:58.297Z] bash: line 1: subscription-manager: command not found
[2026-04-16T01:21:58.297Z] Domain 'an-a01n01' destroyed
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Domain 'an-a01n01' has been undefined
[2026-04-16T01:21:58.297Z] 
[2026-04-16T01:21:58.297Z] Warning: Permanently added 'an-a01n02' (ED25519) to the list of known hosts.
[2026-04-16T01:21:58.665Z] bash: line 1: rhc: command not found
[2026-04-16T01:21:59.033Z] bash: line 1: insights-client: command not found
[2026-04-16T01:21:59.033Z] bash: line 1: subscription-manager: command not found
[2026-04-16T01:22:02.223Z] Domain 'an-a01n02' destroyed
[2026-04-16T01:22:02.223Z] 
[2026-04-16T01:22:02.223Z] Domain 'an-a01n02' has been undefined
[2026-04-16T01:22:02.223Z] 
[2026-04-16T01:22:02.223Z] Warning: Permanently added 'an-a01dr01' (ED25519) to the list of known hosts.
[2026-04-16T01:22:02.592Z] bash: line 1: rhc: command not found
[2026-04-16T01:22:02.960Z] bash: line 1: insights-client: command not found
[2026-04-16T01:22:03.329Z] bash: line 1: subscription-manager: command not found
[2026-04-16T01:22:05.781Z] Domain 'an-a01dr01' destroyed
[2026-04-16T01:22:05.781Z] 
[2026-04-16T01:22:05.781Z] Domain 'an-a01dr01' has been undefined
[2026-04-16T01:22:05.781Z] 
[2026-04-16T01:22:06.149Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-16T01:22:06.149Z] Genering ssh keys and ssh config
[2026-04-16T01:22:06.149Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:22:06.518Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:22:06.518Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:22:06.518Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:22:06.518Z] # github.com:22 SSH-2.0-3992d52
[2026-04-16T01:22:06.518Z] Cache already updated
[2026-04-16T01:22:06.518Z] Creating nodes disks
[2026-04-16T01:22:14.180Z] Formatting 'an-striker01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/rhel-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-striker01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-striker02-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/rhel-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-striker02-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01n01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/rhel-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01n01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01n02-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/rhel-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01n02-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01dr01-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/rhel-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.180Z] Formatting 'an-a01dr01-vol2.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 lazy_refcounts=off refcount_bits=16
[2026-04-16T01:22:14.181Z] Generating an-test-deployX kickstart files/isos
[2026-04-16T01:22:14.181Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project.
[2026-04-16T01:22:14.181Z] 
[2026-04-16T01:22:14.181Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy1.iso'
[2026-04-16T01:22:14.181Z] Media current: stdio file, overwriteable
[2026-04-16T01:22:14.181Z] Media status : is blank
[2026-04-16T01:22:14.181Z] Media summary: 0 sessions, 0 data blocks, 0 data,  801g free
[2026-04-16T01:22:14.181Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks1'
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.181Z] ISO image produced: 184 sectors
[2026-04-16T01:22:14.181Z] Written to medium : 184 sectors at LBA 0
[2026-04-16T01:22:14.181Z] Writing to 'stdio:/srv/anvil/snapshots/deploy1.iso' completed successfully.
[2026-04-16T01:22:14.181Z] 
[2026-04-16T01:22:14.181Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project.
[2026-04-16T01:22:14.181Z] 
[2026-04-16T01:22:14.181Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy2.iso'
[2026-04-16T01:22:14.181Z] Media current: stdio file, overwriteable
[2026-04-16T01:22:14.181Z] Media status : is blank
[2026-04-16T01:22:14.181Z] Media summary: 0 sessions, 0 data blocks, 0 data,  807g free
[2026-04-16T01:22:14.181Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks2'
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.181Z] ISO image produced: 184 sectors
[2026-04-16T01:22:14.181Z] Written to medium : 184 sectors at LBA 0
[2026-04-16T01:22:14.181Z] Writing to 'stdio:/srv/anvil/snapshots/deploy2.iso' completed successfully.
[2026-04-16T01:22:14.181Z] 
[2026-04-16T01:22:14.181Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project.
[2026-04-16T01:22:14.181Z] 
[2026-04-16T01:22:14.181Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy3.iso'
[2026-04-16T01:22:14.181Z] Media current: stdio file, overwriteable
[2026-04-16T01:22:14.181Z] Media status : is blank
[2026-04-16T01:22:14.181Z] Media summary: 0 sessions, 0 data blocks, 0 data,  807g free
[2026-04-16T01:22:14.181Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks3'
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.181Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.550Z] ISO image produced: 184 sectors
[2026-04-16T01:22:14.550Z] Written to medium : 184 sectors at LBA 0
[2026-04-16T01:22:14.550Z] Writing to 'stdio:/srv/anvil/snapshots/deploy3.iso' completed successfully.
[2026-04-16T01:22:14.550Z] 
[2026-04-16T01:22:14.550Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project.
[2026-04-16T01:22:14.550Z] 
[2026-04-16T01:22:14.550Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy4.iso'
[2026-04-16T01:22:14.550Z] Media current: stdio file, overwriteable
[2026-04-16T01:22:14.550Z] Media status : is blank
[2026-04-16T01:22:14.550Z] Media summary: 0 sessions, 0 data blocks, 0 data,  807g free
[2026-04-16T01:22:14.550Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks4'
[2026-04-16T01:22:14.550Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.550Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.550Z] ISO image produced: 184 sectors
[2026-04-16T01:22:14.550Z] Written to medium : 184 sectors at LBA 0
[2026-04-16T01:22:14.550Z] Writing to 'stdio:/srv/anvil/snapshots/deploy4.iso' completed successfully.
[2026-04-16T01:22:14.550Z] 
[2026-04-16T01:22:14.550Z] xorriso 1.5.4 : RockRidge filesystem manipulator, libburnia project.
[2026-04-16T01:22:14.550Z] 
[2026-04-16T01:22:14.550Z] Drive current: -outdev 'stdio:/srv/anvil/snapshots/deploy5.iso'
[2026-04-16T01:22:14.550Z] Media current: stdio file, overwriteable
[2026-04-16T01:22:14.550Z] Media status : is blank
[2026-04-16T01:22:14.550Z] Media summary: 0 sessions, 0 data blocks, 0 data,  807g free
[2026-04-16T01:22:14.550Z] Added to ISO image: directory '/'='/srv/anvil/configs/ks5'
[2026-04-16T01:22:14.550Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.550Z] xorriso : UPDATE :       1 files added in 1 seconds
[2026-04-16T01:22:14.550Z] ISO image produced: 184 sectors
[2026-04-16T01:22:14.550Z] Written to medium : 184 sectors at LBA 0
[2026-04-16T01:22:14.550Z] Writing to 'stdio:/srv/anvil/snapshots/deploy5.iso' completed successfully.
[2026-04-16T01:22:14.550Z] 
[2026-04-16T01:22:14.550Z] Generating cloud-init configs
[2026-04-16T01:22:14.550Z] Generating cloud-init metadata and seed images
[2026-04-16T01:22:14.919Z] wrote /srv/anvil/snapshots/an-striker01-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-16T01:22:14.919Z] wrote /srv/anvil/snapshots/an-striker02-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-16T01:22:14.919Z] wrote /srv/anvil/snapshots/an-a01n01-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-16T01:22:15.287Z] wrote /srv/anvil/snapshots/an-a01n02-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-16T01:22:15.287Z] wrote /srv/anvil/snapshots/an-a01dr01-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-16T01:22:15.287Z] Creating VMs
[2026-04-16T01:22:17.104Z] 
[2026-04-16T01:22:17.104Z] Starting install...
[2026-04-16T01:22:17.104Z] 
[2026-04-16T01:22:17.104Z] Creating domain...                                          |         00:00     
[2026-04-16T01:22:17.104Z] Domain creation completed.
[2026-04-16T01:22:18.920Z] 
[2026-04-16T01:22:18.920Z] Starting install...
[2026-04-16T01:22:18.920Z] 
[2026-04-16T01:22:18.920Z] Creating domain...                                          |         00:00     
[2026-04-16T01:22:18.920Z] Domain creation completed.
[2026-04-16T01:22:20.744Z] 
[2026-04-16T01:22:20.744Z] Starting install...
[2026-04-16T01:22:20.744Z] 
[2026-04-16T01:22:20.744Z] Creating domain...                                          |         00:00     
[2026-04-16T01:22:20.744Z] Domain creation completed.
[2026-04-16T01:22:22.562Z] 
[2026-04-16T01:22:22.562Z] Starting install...
[2026-04-16T01:22:22.562Z] 
[2026-04-16T01:22:22.562Z] Creating domain...                                          |         00:00     
[2026-04-16T01:22:22.562Z] Domain creation completed.
[2026-04-16T01:22:24.380Z] 
[2026-04-16T01:22:24.380Z] Starting install...
[2026-04-16T01:22:24.380Z] 
[2026-04-16T01:22:24.380Z] Creating domain...                                          |         00:00     
[2026-04-16T01:22:24.380Z] Domain creation completed.
[2026-04-16T01:22:24.380Z] Waiting for nodes and cloud-init to complete full init
[2026-04-16T01:22:27.572Z] cloud-init status node an-striker01: 
[2026-04-16T01:22:30.762Z] cloud-init status node an-striker02: 
[2026-04-16T01:22:33.954Z] cloud-init status node an-a01n01: 
[2026-04-16T01:22:36.407Z] cloud-init status node an-a01n02: 
[2026-04-16T01:22:39.602Z] cloud-init status node an-a01dr01: 
[2026-04-16T01:22:39.602Z] Wed Apr 15 21:22:39 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:22:50.902Z] cloud-init status node an-striker01: running
[2026-04-16T01:22:52.169Z] cloud-init status node an-striker02: running
[2026-04-16T01:22:52.957Z] cloud-init status node an-a01n01: running
[2026-04-16T01:22:54.224Z] cloud-init status node an-a01n02: running
[2026-04-16T01:22:55.491Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:22:55.491Z] Wed Apr 15 21:22:55 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:23:06.789Z] cloud-init status node an-striker01: running
[2026-04-16T01:23:07.159Z] cloud-init status node an-striker02: running
[2026-04-16T01:23:08.426Z] cloud-init status node an-a01n01: running
[2026-04-16T01:23:09.214Z] cloud-init status node an-a01n02: running
[2026-04-16T01:23:10.002Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:23:10.002Z] Wed Apr 15 21:23:09 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:23:21.303Z] cloud-init status node an-striker01: running
[2026-04-16T01:23:22.092Z] cloud-init status node an-striker02: running
[2026-04-16T01:23:22.879Z] cloud-init status node an-a01n01: running
[2026-04-16T01:23:23.667Z] cloud-init status node an-a01n02: running
[2026-04-16T01:23:24.932Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:23:24.932Z] Wed Apr 15 21:23:24 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:23:36.240Z] cloud-init status node an-striker01: running
[2026-04-16T01:23:36.614Z] cloud-init status node an-striker02: running
[2026-04-16T01:23:37.445Z] cloud-init status node an-a01n01: running
[2026-04-16T01:23:38.253Z] cloud-init status node an-a01n02: running
[2026-04-16T01:23:39.520Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:23:39.520Z] Wed Apr 15 21:23:39 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:23:50.918Z] cloud-init status node an-striker01: running
[2026-04-16T01:23:51.286Z] cloud-init status node an-striker02: running
[2026-04-16T01:23:52.079Z] cloud-init status node an-a01n01: running
[2026-04-16T01:23:53.387Z] cloud-init status node an-a01n02: running
[2026-04-16T01:23:54.200Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:23:54.200Z] Wed Apr 15 21:23:53 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:24:05.704Z] cloud-init status node an-striker01: running
[2026-04-16T01:24:06.106Z] cloud-init status node an-striker02: running
[2026-04-16T01:24:07.014Z] cloud-init status node an-a01n01: running
[2026-04-16T01:24:07.805Z] cloud-init status node an-a01n02: running
[2026-04-16T01:24:08.595Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:24:08.595Z] Wed Apr 15 21:24:08 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:24:20.132Z] cloud-init status node an-striker01: running
[2026-04-16T01:24:20.507Z] cloud-init status node an-striker02: running
[2026-04-16T01:24:21.787Z] cloud-init status node an-a01n01: running
[2026-04-16T01:24:22.582Z] cloud-init status node an-a01n02: running
[2026-04-16T01:24:23.864Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:24:23.864Z] Wed Apr 15 21:24:23 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:24:35.236Z] cloud-init status node an-striker01: running
[2026-04-16T01:24:35.611Z] cloud-init status node an-striker02: running
[2026-04-16T01:24:36.894Z] cloud-init status node an-a01n01: running
[2026-04-16T01:24:37.692Z] cloud-init status node an-a01n02: running
[2026-04-16T01:24:38.488Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:24:38.488Z] Wed Apr 15 21:24:38 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:24:49.823Z] cloud-init status node an-striker01: running
[2026-04-16T01:24:50.197Z] cloud-init status node an-striker02: running
[2026-04-16T01:24:51.475Z] cloud-init status node an-a01n01: running
[2026-04-16T01:24:52.268Z] cloud-init status node an-a01n02: running
[2026-04-16T01:24:53.059Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:24:53.059Z] Wed Apr 15 21:24:52 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:25:04.426Z] cloud-init status node an-striker01: running
[2026-04-16T01:25:05.283Z] cloud-init status node an-striker02: running
[2026-04-16T01:25:06.283Z] cloud-init status node an-a01n01: running
[2026-04-16T01:25:06.866Z] cloud-init status node an-a01n02: running
[2026-04-16T01:25:08.223Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:25:08.223Z] Wed Apr 15 21:25:07 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:25:20.181Z] cloud-init status node an-striker01: running
[2026-04-16T01:25:20.181Z] cloud-init status node an-striker02: running
[2026-04-16T01:25:21.063Z] cloud-init status node an-a01n01: running
[2026-04-16T01:25:21.993Z] cloud-init status node an-a01n02: running
[2026-04-16T01:25:22.900Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:25:22.900Z] Wed Apr 15 21:25:22 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:25:34.672Z] cloud-init status node an-striker01: running
[2026-04-16T01:25:34.672Z] cloud-init status node an-striker02: running
[2026-04-16T01:25:35.478Z] cloud-init status node an-a01n01: running
[2026-04-16T01:25:36.770Z] cloud-init status node an-a01n02: running
[2026-04-16T01:25:37.574Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:25:37.574Z] Wed Apr 15 21:25:37 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:25:48.931Z] cloud-init status node an-striker01: running
[2026-04-16T01:25:49.301Z] cloud-init status node an-striker02: running
[2026-04-16T01:25:50.093Z] cloud-init status node an-a01n01: running
[2026-04-16T01:25:51.364Z] cloud-init status node an-a01n02: running
[2026-04-16T01:25:57.893Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:25:57.893Z] Wed Apr 15 21:25:56 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:26:09.453Z] cloud-init status node an-striker01: running
[2026-04-16T01:26:09.453Z] cloud-init status node an-striker02: running
[2026-04-16T01:26:10.317Z] cloud-init status node an-a01n01: running
[2026-04-16T01:26:11.083Z] cloud-init status node an-a01n02: running
[2026-04-16T01:26:11.953Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:26:11.953Z] Wed Apr 15 21:26:11 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:26:23.389Z] cloud-init status node an-striker01: running
[2026-04-16T01:26:23.758Z] cloud-init status node an-striker02: running
[2026-04-16T01:26:25.028Z] cloud-init status node an-a01n01: running
[2026-04-16T01:26:25.815Z] cloud-init status node an-a01n02: running
[2026-04-16T01:26:26.603Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:26:26.603Z] Wed Apr 15 21:26:26 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:26:37.904Z] cloud-init status node an-striker01: running
[2026-04-16T01:26:38.693Z] cloud-init status node an-striker02: running
[2026-04-16T01:26:39.482Z] cloud-init status node an-a01n01: running
[2026-04-16T01:26:40.753Z] cloud-init status node an-a01n02: running
[2026-04-16T01:26:41.544Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:26:41.544Z] Wed Apr 15 21:26:41 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:26:52.850Z] cloud-init status node an-striker01: running
[2026-04-16T01:26:53.647Z] cloud-init status node an-striker02: running
[2026-04-16T01:26:54.918Z] cloud-init status node an-a01n01: running
[2026-04-16T01:26:55.707Z] cloud-init status node an-a01n02: running
[2026-04-16T01:26:56.974Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:26:56.974Z] Wed Apr 15 21:26:56 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:27:08.283Z] cloud-init status node an-striker01: running
[2026-04-16T01:27:08.652Z] cloud-init status node an-striker02: running
[2026-04-16T01:27:09.920Z] cloud-init status node an-a01n01: running
[2026-04-16T01:27:10.710Z] cloud-init status node an-a01n02: running
[2026-04-16T01:27:11.498Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:27:11.498Z] Wed Apr 15 21:27:11 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:27:22.810Z] cloud-init status node an-striker01: running
[2026-04-16T01:27:23.599Z] cloud-init status node an-striker02: running
[2026-04-16T01:27:24.866Z] cloud-init status node an-a01n01: running
[2026-04-16T01:27:25.654Z] cloud-init status node an-a01n02: running
[2026-04-16T01:27:26.923Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:27:26.923Z] Wed Apr 15 21:27:26 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:27:38.223Z] cloud-init status node an-striker01: running
[2026-04-16T01:27:38.592Z] cloud-init status node an-striker02: running
[2026-04-16T01:27:39.861Z] cloud-init status node an-a01n01: running
[2026-04-16T01:27:40.650Z] cloud-init status node an-a01n02: running
[2026-04-16T01:27:41.918Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:27:41.918Z] Wed Apr 15 21:27:41 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:27:53.219Z] cloud-init status node an-striker01: running
[2026-04-16T01:27:53.219Z] cloud-init status node an-striker02: running
[2026-04-16T01:27:54.486Z] cloud-init status node an-a01n01: running
[2026-04-16T01:27:55.274Z] cloud-init status node an-a01n02: running
[2026-04-16T01:27:56.062Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:27:56.062Z] Wed Apr 15 21:27:55 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:28:07.363Z] cloud-init status node an-striker01: running
[2026-04-16T01:28:07.732Z] cloud-init status node an-striker02: running
[2026-04-16T01:28:08.522Z] cloud-init status node an-a01n01: running
[2026-04-16T01:28:09.790Z] cloud-init status node an-a01n02: running
[2026-04-16T01:28:10.578Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:28:10.578Z] Wed Apr 15 21:28:10 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:28:21.877Z] cloud-init status node an-striker01: running
[2026-04-16T01:28:22.664Z] cloud-init status node an-striker02: running
[2026-04-16T01:28:23.453Z] cloud-init status node an-a01n01: running
[2026-04-16T01:28:24.240Z] cloud-init status node an-a01n02: running
[2026-04-16T01:28:25.504Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:28:25.504Z] Wed Apr 15 21:28:25 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:28:36.807Z] cloud-init status node an-striker01: running
[2026-04-16T01:28:37.176Z] cloud-init status node an-striker02: running
[2026-04-16T01:28:37.964Z] cloud-init status node an-a01n01: running
[2026-04-16T01:28:39.231Z] cloud-init status node an-a01n02: running
[2026-04-16T01:28:40.018Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:28:40.018Z] Wed Apr 15 21:28:39 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:28:51.345Z] cloud-init status node an-striker01: running
[2026-04-16T01:28:52.133Z] cloud-init status node an-striker02: running
[2026-04-16T01:28:52.920Z] cloud-init status node an-a01n01: running
[2026-04-16T01:28:54.185Z] cloud-init status node an-a01n02: running
[2026-04-16T01:28:54.973Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:28:54.973Z] Wed Apr 15 21:28:54 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:29:08.609Z] cloud-init status node an-striker01: running
[2026-04-16T01:29:08.978Z] cloud-init status node an-striker02: running
[2026-04-16T01:29:10.243Z] cloud-init status node an-a01n01: running
[2026-04-16T01:29:11.031Z] cloud-init status node an-a01n02: running
[2026-04-16T01:29:12.297Z] cloud-init status node an-a01dr01: running
[2026-04-16T01:29:12.297Z] Wed Apr 15 21:29:12 EDT 2026 actual: 0 expected: 5
[2026-04-16T01:29:25.943Z] cloud-init status node an-striker01: running
[2026-04-16T01:29:25.943Z] cloud-init status node an-striker02: running
[2026-04-16T01:29:26.312Z] cloud-init status node an-a01n01: done
[2026-04-16T01:29:27.099Z] cloud-init status node an-a01n02: done
[2026-04-16T01:29:27.887Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:29:27.887Z] Wed Apr 15 21:29:27 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:29:39.188Z] cloud-init status node an-striker01: running
[2026-04-16T01:29:39.974Z] cloud-init status node an-striker02: running
[2026-04-16T01:29:41.240Z] cloud-init status node an-a01n01: done
[2026-04-16T01:29:42.027Z] cloud-init status node an-a01n02: done
[2026-04-16T01:29:43.563Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:29:43.563Z] Wed Apr 15 21:29:42 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:29:54.505Z] cloud-init status node an-striker01: running
[2026-04-16T01:29:54.874Z] cloud-init status node an-striker02: running
[2026-04-16T01:29:55.662Z] cloud-init status node an-a01n01: done
[2026-04-16T01:29:56.928Z] cloud-init status node an-a01n02: done
[2026-04-16T01:29:57.719Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:29:57.719Z] Wed Apr 15 21:29:57 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:30:09.012Z] cloud-init status node an-striker01: running
[2026-04-16T01:30:09.799Z] cloud-init status node an-striker02: running
[2026-04-16T01:30:10.586Z] cloud-init status node an-a01n01: done
[2026-04-16T01:30:11.852Z] cloud-init status node an-a01n02: done
[2026-04-16T01:30:12.640Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:30:12.640Z] Wed Apr 15 21:30:12 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:30:23.940Z] cloud-init status node an-striker01: running
[2026-04-16T01:30:24.727Z] cloud-init status node an-striker02: running
[2026-04-16T01:30:25.993Z] cloud-init status node an-a01n01: done
[2026-04-16T01:30:26.781Z] cloud-init status node an-a01n02: done
[2026-04-16T01:30:27.568Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:30:27.568Z] Wed Apr 15 21:30:27 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:30:41.207Z] cloud-init status node an-striker01: running
[2026-04-16T01:30:41.207Z] cloud-init status node an-striker02: running
[2026-04-16T01:30:42.473Z] cloud-init status node an-a01n01: done
[2026-04-16T01:30:43.260Z] cloud-init status node an-a01n02: done
[2026-04-16T01:30:44.528Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:30:44.528Z] Wed Apr 15 21:30:44 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:30:55.827Z] cloud-init status node an-striker01: running
[2026-04-16T01:30:57.108Z] cloud-init status node an-striker02: running
[2026-04-16T01:30:58.375Z] cloud-init status node an-a01n01: done
[2026-04-16T01:30:59.163Z] cloud-init status node an-a01n02: done
[2026-04-16T01:31:00.428Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:31:00.428Z] Wed Apr 15 21:30:59 EDT 2026 actual: 3 expected: 5
[2026-04-16T01:31:12.016Z] cloud-init status node an-striker01: done
[2026-04-16T01:31:12.385Z] cloud-init status node an-striker02: done
[2026-04-16T01:31:13.173Z] cloud-init status node an-a01n01: done
[2026-04-16T01:31:14.445Z] cloud-init status node an-a01n02: done
[2026-04-16T01:31:15.233Z] cloud-init status node an-a01dr01: done
[2026-04-16T01:31:15.233Z] Wed Apr 15 21:31:15 EDT 2026 actual: 5 expected: 5
[2026-04-16T01:31:15.233Z] Building simengine model
[2026-04-16T01:31:31.666Z] Generating anvil striker auto config
[2026-04-16T01:31:32.037Z] Cloning into 'anvil-test-suite'...
[2026-04-16T01:31:32.920Z] generated ansible config:
[2026-04-16T01:31:32.920Z] =========================
[2026-04-16T01:31:32.920Z] [defaults]
[2026-04-16T01:31:32.920Z] inventory = ansible-inventory
[2026-04-16T01:31:32.920Z] forks = 500
[2026-04-16T01:31:32.920Z] any_errors_fatal = true
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:32.920Z] [ssh_connection]
[2026-04-16T01:31:32.920Z] retries = 20
[2026-04-16T01:31:32.920Z] =========================
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:32.920Z] generated ansible inventory:
[2026-04-16T01:31:32.920Z] ============================
[2026-04-16T01:31:32.920Z] [strikers]
[2026-04-16T01:31:32.920Z] an-striker01
[2026-04-16T01:31:32.920Z] an-striker02
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:32.920Z] [nodes]
[2026-04-16T01:31:32.920Z] an-a01n01
[2026-04-16T01:31:32.920Z] an-a01n02
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:32.920Z] [drnodes]
[2026-04-16T01:31:32.920Z] an-a01dr01
[2026-04-16T01:31:32.920Z] ============================
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:32.920Z] Checking connectivity to nodes
[2026-04-16T01:31:32.920Z] 
[2026-04-16T01:31:35.441Z] an-a01dr01 | SUCCESS => {
[2026-04-16T01:31:35.441Z]     "ansible_facts": {
[2026-04-16T01:31:35.441Z]         "discovered_interpreter_python": "/usr/bin/python3"
[2026-04-16T01:31:35.441Z]     },
[2026-04-16T01:31:35.441Z]     "changed": false,
[2026-04-16T01:31:35.441Z]     "ping": "pong"
[2026-04-16T01:31:35.441Z] }
[2026-04-16T01:31:35.441Z] an-a01n01 | SUCCESS => {
[2026-04-16T01:31:35.441Z]     "ansible_facts": {
[2026-04-16T01:31:35.441Z]         "discovered_interpreter_python": "/usr/bin/python3"
[2026-04-16T01:31:35.441Z]     },
[2026-04-16T01:31:35.441Z]     "changed": false,
[2026-04-16T01:31:35.441Z]     "ping": "pong"
[2026-04-16T01:31:35.441Z] }
[2026-04-16T01:31:35.441Z] an-a01n02 | SUCCESS => {
[2026-04-16T01:31:35.441Z]     "ansible_facts": {
[2026-04-16T01:31:35.441Z]         "discovered_interpreter_python": "/usr/bin/python3"
[2026-04-16T01:31:35.441Z]     },
[2026-04-16T01:31:35.441Z]     "changed": false,
[2026-04-16T01:31:35.441Z]     "ping": "pong"
[2026-04-16T01:31:35.441Z] }
[2026-04-16T01:31:35.441Z] an-striker01 | SUCCESS => {
[2026-04-16T01:31:35.441Z]     "ansible_facts": {
[2026-04-16T01:31:35.441Z]         "discovered_interpreter_python": "/usr/bin/python3"
[2026-04-16T01:31:35.441Z]     },
[2026-04-16T01:31:35.441Z]     "changed": false,
[2026-04-16T01:31:35.441Z]     "ping": "pong"
[2026-04-16T01:31:35.441Z] }
[2026-04-16T01:31:35.441Z] an-striker02 | SUCCESS => {
[2026-04-16T01:31:35.441Z]     "ansible_facts": {
[2026-04-16T01:31:35.441Z]         "discovered_interpreter_python": "/usr/bin/python3"
[2026-04-16T01:31:35.441Z]     },
[2026-04-16T01:31:35.441Z]     "changed": false,
[2026-04-16T01:31:35.441Z]     "ping": "pong"
[2026-04-16T01:31:35.441Z] }
[2026-04-16T01:31:35.441Z] 
[2026-04-16T01:31:35.811Z] 
[2026-04-16T01:31:35.811Z] PLAY [Setup all nodes] *********************************************************
[2026-04-16T01:31:35.811Z] 
[2026-04-16T01:31:35.811Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:31:38.286Z] ok: [an-a01n02]
[2026-04-16T01:31:38.286Z] ok: [an-a01dr01]
[2026-04-16T01:31:38.286Z] ok: [an-a01n01]
[2026-04-16T01:31:38.286Z] ok: [an-striker02]
[2026-04-16T01:31:38.286Z] ok: [an-striker01]
[2026-04-16T01:31:38.286Z] 
[2026-04-16T01:31:38.286Z] TASK [create /opt/MegaRAID/storcli/] *******************************************
[2026-04-16T01:31:39.083Z] changed: [an-a01n02]
[2026-04-16T01:31:39.083Z] changed: [an-a01dr01]
[2026-04-16T01:31:39.083Z] changed: [an-a01n01]
[2026-04-16T01:31:39.083Z] changed: [an-striker01]
[2026-04-16T01:31:39.083Z] changed: [an-striker02]
[2026-04-16T01:31:39.083Z] 
[2026-04-16T01:31:39.083Z] TASK [wipe old storcli64] ******************************************************
[2026-04-16T01:31:40.350Z] ok: [an-a01n01]
[2026-04-16T01:31:40.350Z] ok: [an-a01n02]
[2026-04-16T01:31:40.350Z] ok: [an-a01dr01]
[2026-04-16T01:31:40.350Z] ok: [an-striker02]
[2026-04-16T01:31:40.350Z] ok: [an-striker01]
[2026-04-16T01:31:40.350Z] 
[2026-04-16T01:31:40.350Z] TASK [get latest Simengine storcli64] ******************************************
[2026-04-16T01:31:41.622Z] changed: [an-a01dr01]
[2026-04-16T01:31:41.622Z] changed: [an-a01n02]
[2026-04-16T01:31:41.622Z] changed: [an-a01n01]
[2026-04-16T01:31:41.622Z] changed: [an-striker01]
[2026-04-16T01:31:41.622Z] changed: [an-striker02]
[2026-04-16T01:31:41.622Z] 
[2026-04-16T01:31:41.622Z] PLAY [setup strikers] **********************************************************
[2026-04-16T01:31:41.622Z] 
[2026-04-16T01:31:41.622Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:31:43.440Z] ok: [an-striker01]
[2026-04-16T01:31:43.440Z] ok: [an-striker02]
[2026-04-16T01:31:43.440Z] 
[2026-04-16T01:31:43.440Z] TASK [copy striker autogenerated config] ***************************************
[2026-04-16T01:31:45.257Z] changed: [an-striker01]
[2026-04-16T01:31:45.257Z] changed: [an-striker02]
[2026-04-16T01:31:45.257Z] 
[2026-04-16T01:31:45.257Z] PLAY [setup lvm storage] *******************************************************
[2026-04-16T01:31:45.257Z] 
[2026-04-16T01:31:45.257Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:31:47.077Z] ok: [an-a01n01]
[2026-04-16T01:31:47.077Z] ok: [an-a01dr01]
[2026-04-16T01:31:47.077Z] ok: [an-a01n02]
[2026-04-16T01:31:47.077Z] 
[2026-04-16T01:31:47.077Z] TASK [check if vg already exists] **********************************************
[2026-04-16T01:31:47.446Z] ok: [an-a01dr01]
[2026-04-16T01:31:47.446Z] ok: [an-a01n01]
[2026-04-16T01:31:47.446Z] ok: [an-a01n02]
[2026-04-16T01:31:47.446Z] 
[2026-04-16T01:31:47.446Z] TASK [vgcheck] *****************************************************************
[2026-04-16T01:31:47.446Z] skipping: [an-a01n01]
[2026-04-16T01:31:47.446Z] 
[2026-04-16T01:31:47.446Z] TASK [create anvil-test-vg] ****************************************************
[2026-04-16T01:31:48.712Z] changed: [an-a01n01]
[2026-04-16T01:31:48.712Z] changed: [an-a01dr01]
[2026-04-16T01:31:48.712Z] changed: [an-a01n02]
[2026-04-16T01:31:48.712Z] 
[2026-04-16T01:31:48.712Z] PLAY [deploy anvil] ************************************************************
[2026-04-16T01:31:48.712Z] 
[2026-04-16T01:31:48.712Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:31:50.540Z] ok: [an-striker01]
[2026-04-16T01:31:50.540Z] ok: [an-striker02]
[2026-04-16T01:31:50.540Z] 
[2026-04-16T01:31:50.540Z] TASK [check if installation is in progress] ************************************
[2026-04-16T01:31:51.815Z] ok: [an-striker01]
[2026-04-16T01:31:51.815Z] ok: [an-striker02]
[2026-04-16T01:31:51.815Z] 
[2026-04-16T01:31:51.815Z] TASK [register installation is in progress] ************************************
[2026-04-16T01:31:53.096Z] changed: [an-striker01]
[2026-04-16T01:31:53.096Z] changed: [an-striker02]
[2026-04-16T01:31:53.096Z] 
[2026-04-16T01:31:53.096Z] TASK [start anvil deployment and configuration] ********************************
[2026-04-16T01:31:56.288Z] changed: [an-striker01]
[2026-04-16T01:31:56.289Z] changed: [an-striker02]
[2026-04-16T01:31:56.289Z] 
[2026-04-16T01:31:56.289Z] TASK [Wait up to 20 minutes for DB to be running on both strikers] *************
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (120 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (120 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (119 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (119 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (118 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (118 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (117 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (117 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (116 retries left).
[2026-04-16T01:37:53.162Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (116 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (115 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (115 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (114 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (114 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (113 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (113 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (112 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (112 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (111 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (111 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (110 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (110 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (109 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (109 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (108 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (108 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (107 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (107 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (106 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (106 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (105 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (105 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (104 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (104 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (103 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (103 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (102 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (102 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (101 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (101 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (100 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (100 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (99 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (99 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (98 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (98 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (97 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (97 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (96 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (96 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (95 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (95 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (94 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (94 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (93 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (93 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (92 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (92 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker02 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (91 retries left).
[2026-04-16T01:37:53.163Z] FAILED - RETRYING: [an-striker01 -> localhost]: Wait up to 20 minutes for DB to be running on both strikers (91 retries left).
[2026-04-16T01:37:53.163Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:37:53.163Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:37:53.163Z] 
[2026-04-16T01:37:53.163Z] TASK [Wait up to 20 minutes for both striker-db-status to sync] ****************
[2026-04-16T01:38:34.126Z] FAILED - RETRYING: [an-striker02]: Wait up to 20 minutes for both striker-db-status to sync (120 retries left).
[2026-04-16T01:38:34.127Z] ok: [an-striker01]
[2026-04-16T01:38:34.127Z] FAILED - RETRYING: [an-striker02]: Wait up to 20 minutes for both striker-db-status to sync (119 retries left).
[2026-04-16T01:38:34.127Z] FAILED - RETRYING: [an-striker02]: Wait up to 20 minutes for both striker-db-status to sync (118 retries left).
[2026-04-16T01:38:34.127Z] ok: [an-striker02]
[2026-04-16T01:38:34.127Z] 
[2026-04-16T01:38:34.127Z] TASK [wait up to 20 minutes for nodes to join the database] ********************
[2026-04-16T01:44:15.356Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (120 retries left).
[2026-04-16T01:44:15.356Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (120 retries left).
[2026-04-16T01:44:15.356Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (119 retries left).
[2026-04-16T01:44:15.356Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (119 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (118 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (118 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (117 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (117 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (116 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (116 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (115 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (115 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (114 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (114 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (113 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (113 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (112 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (112 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (111 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (111 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (110 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (110 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (109 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (109 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (108 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (108 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (107 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (107 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (106 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (106 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (105 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (105 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (104 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (104 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (103 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (103 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (102 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (102 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (101 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (101 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (100 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (100 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (99 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (99 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (98 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (98 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (97 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (97 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (96 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (96 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (95 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (95 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (94 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (94 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (93 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (93 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (92 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (92 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (91 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (91 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (90 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (90 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (89 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (89 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (88 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (88 retries left).
[2026-04-16T01:44:15.357Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (87 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (87 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (86 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (86 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (85 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (85 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (84 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (84 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (83 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (83 retries left).
[2026-04-16T01:47:55.396Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (82 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (82 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (81 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (81 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (80 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (80 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (79 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (79 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (78 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (78 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (77 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (77 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (76 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (76 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (75 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (75 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (74 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (74 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (73 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (73 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (72 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (72 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (71 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (71 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (70 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (70 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (69 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (69 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (68 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (68 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for nodes to join the database (67 retries left).
[2026-04-16T01:47:55.397Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for nodes to join the database (67 retries left).
[2026-04-16T01:47:55.397Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:47:55.397Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:47:55.397Z] 
[2026-04-16T01:47:55.397Z] TASK [wait up to 20 minutes for anvil nodes to form] ***************************
[2026-04-16T01:47:59.482Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for anvil nodes to form (120 retries left).
[2026-04-16T01:47:59.482Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for anvil nodes to form (120 retries left).
[2026-04-16T01:47:59.482Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:47:59.482Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:47:59.482Z] 
[2026-04-16T01:47:59.482Z] TASK [wait up to 60 minutes for pacemaker to be configured] ********************
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (360 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (360 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (359 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (359 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (358 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (358 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (357 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (357 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (356 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (356 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (355 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (355 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (354 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (354 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (353 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (353 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (352 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (352 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (351 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (351 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (350 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (350 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (349 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (349 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (348 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (348 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 60 minutes for pacemaker to be configured (347 retries left).
[2026-04-16T01:50:23.968Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 60 minutes for pacemaker to be configured (347 retries left).
[2026-04-16T01:50:23.968Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:50:23.968Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:50:23.968Z] 
[2026-04-16T01:50:23.968Z] TASK [wait up to 20 minutes for drbd to be configured] *************************
[2026-04-16T01:50:47.722Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for drbd to be configured (120 retries left).
[2026-04-16T01:50:47.722Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for drbd to be configured (120 retries left).
[2026-04-16T01:50:47.722Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for drbd to be configured (119 retries left).
[2026-04-16T01:50:47.722Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for drbd to be configured (119 retries left).
[2026-04-16T01:50:47.722Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:50:47.722Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:50:47.722Z] 
[2026-04-16T01:50:47.722Z] TASK [wait up to 20 minutes for any other configuration job to complete] *******
[2026-04-16T01:50:55.442Z] FAILED - RETRYING: [an-striker01 -> localhost]: wait up to 20 minutes for any other configuration job to complete (120 retries left).
[2026-04-16T01:50:55.442Z] FAILED - RETRYING: [an-striker02 -> localhost]: wait up to 20 minutes for any other configuration job to complete (120 retries left).
[2026-04-16T01:50:55.442Z] ok: [an-striker01 -> localhost]
[2026-04-16T01:50:55.442Z] ok: [an-striker02 -> localhost]
[2026-04-16T01:50:55.442Z] 
[2026-04-16T01:50:55.442Z] PLAY [check network status after deployment] ***********************************
[2026-04-16T01:50:55.442Z] 
[2026-04-16T01:50:55.442Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:50:57.913Z] ok: [an-striker02]
[2026-04-16T01:50:57.913Z] ok: [an-striker01]
[2026-04-16T01:50:57.913Z] ok: [an-a01n01]
[2026-04-16T01:50:57.913Z] ok: [an-a01n02]
[2026-04-16T01:50:57.913Z] ok: [an-a01dr01]
[2026-04-16T01:50:57.913Z] 
[2026-04-16T01:50:57.913Z] TASK [check network manager autoconnect is set to yes] *************************
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=ifn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=sn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=ifn1_link2)
[2026-04-16T01:51:07.264Z] skipping: [an-a01dr01] => (item=lo) 
[2026-04-16T01:51:07.264Z] skipping: [an-a01n02] => (item=lo) 
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=ifn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=bcn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=sn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=sn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=bcn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=ifn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=ifn1_bridge1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=bcn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=ifn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=ifn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=sn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=bcn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=ifn1_bridge1)
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=bcn1_link2)
[2026-04-16T01:51:07.264Z] skipping: [an-striker01] => (item=lo) 
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=ifn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=sn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=sn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=bcn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=sn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=bcn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=bcn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=sn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=bcn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=ifn1_bridge1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=ifn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=ifn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=ifn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=bcn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=bcn1_bridge1)
[2026-04-16T01:51:07.264Z] skipping: [an-a01n01] => (item=lo) 
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=ifn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=bcn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=ifn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=bcn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-striker01] => (item=bcn1_link1)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=ifn1_bond1)
[2026-04-16T01:51:07.264Z] skipping: [an-striker02] => (item=lo) 
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=bcn1_bridge1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=bcn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=bcn1_bridge1)
[2026-04-16T01:51:07.264Z] changed: [an-a01dr01] => (item=ifn1_link2)
[2026-04-16T01:51:07.264Z] changed: [an-a01n01] => (item=sn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-striker02] => (item=bcn1_bond1)
[2026-04-16T01:51:07.264Z] changed: [an-a01n02] => (item=ifn1_bond1)
[2026-04-16T01:51:07.264Z] 
[2026-04-16T01:51:07.264Z] PLAY [check pacemaker status after deployment] *********************************
[2026-04-16T01:51:07.264Z] 
[2026-04-16T01:51:07.264Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:51:08.054Z] ok: [an-a01n01]
[2026-04-16T01:51:08.054Z] ok: [an-a01n02]
[2026-04-16T01:51:08.054Z] 
[2026-04-16T01:51:08.054Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T01:51:08.054Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T01:51:08.054Z] 
[2026-04-16T01:51:08.054Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T01:51:12.206Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T01:51:12.206Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T01:51:12.206Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T01:51:12.206Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T01:51:12.206Z] 
[2026-04-16T01:51:12.206Z] PLAY [check drbd kmod] *********************************************************
[2026-04-16T01:51:12.206Z] 
[2026-04-16T01:51:12.206Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:51:15.075Z] ok: [an-a01n02]
[2026-04-16T01:51:15.075Z] ok: [an-a01dr01]
[2026-04-16T01:51:15.075Z] ok: [an-a01n01]
[2026-04-16T01:51:15.075Z] 
[2026-04-16T01:51:15.075Z] TASK [check if drbd kernel module is already loaded] ***************************
[2026-04-16T01:51:15.075Z] ok: [an-a01dr01]
[2026-04-16T01:51:15.075Z] ok: [an-a01n01]
[2026-04-16T01:51:15.075Z] ok: [an-a01n02]
[2026-04-16T01:51:15.075Z] 
[2026-04-16T01:51:15.075Z] TASK [load drbd kernel module] *************************************************
[2026-04-16T01:51:15.075Z] skipping: [an-a01n01]
[2026-04-16T01:51:15.075Z] skipping: [an-a01n02]
[2026-04-16T01:51:15.075Z] skipping: [an-a01dr01]
[2026-04-16T01:51:15.075Z] 
[2026-04-16T01:51:15.075Z] TASK [check if drbd kernel module is loaded] ***********************************
[2026-04-16T01:51:15.075Z] skipping: [an-a01n01]
[2026-04-16T01:51:15.899Z] skipping: [an-a01n02]
[2026-04-16T01:51:15.899Z] skipping: [an-a01dr01]
[2026-04-16T01:51:15.899Z] 
[2026-04-16T01:51:15.899Z] PLAY [Copy iso images to striker01] ********************************************
[2026-04-16T01:51:15.899Z] 
[2026-04-16T01:51:15.899Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:51:17.114Z] ok: [an-striker01]
[2026-04-16T01:51:17.114Z] 
[2026-04-16T01:51:17.114Z] TASK [Wipe old snapshots dir] **************************************************
[2026-04-16T01:51:18.383Z] ok: [an-striker01]
[2026-04-16T01:51:18.383Z] 
[2026-04-16T01:51:18.383Z] TASK [Create snapshots dir] ****************************************************
[2026-04-16T01:51:19.651Z] changed: [an-striker01]
[2026-04-16T01:51:19.651Z] 
[2026-04-16T01:51:19.651Z] TASK [Copy C9S kickstart images] ***********************************************
[2026-04-16T01:51:28.983Z] changed: [an-striker01] => (item=deploy1.iso)
[2026-04-16T01:51:28.983Z] changed: [an-striker01] => (item=deploy2.iso)
[2026-04-16T01:51:28.983Z] changed: [an-striker01] => (item=deploy3.iso)
[2026-04-16T01:51:28.983Z] changed: [an-striker01] => (item=deploy4.iso)
[2026-04-16T01:51:28.983Z] changed: [an-striker01] => (item=deploy5.iso)
[2026-04-16T01:51:28.983Z] 
[2026-04-16T01:51:28.983Z] TASK [Move install isos to anvil upload dir] ***********************************
[2026-04-16T01:51:30.251Z] changed: [an-striker01]
[2026-04-16T01:51:30.251Z] 
[2026-04-16T01:51:30.251Z] TASK [Wipe old snapshots dir] **************************************************
[2026-04-16T01:51:31.518Z] changed: [an-striker01]
[2026-04-16T01:51:31.518Z] 
[2026-04-16T01:51:31.518Z] PLAY [Check iso images propagation] ********************************************
[2026-04-16T01:51:31.518Z] 
[2026-04-16T01:51:31.518Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:51:33.973Z] ok: [an-a01n01]
[2026-04-16T01:51:33.973Z] ok: [an-a01dr01]
[2026-04-16T01:51:33.973Z] ok: [an-a01n02]
[2026-04-16T01:51:33.973Z] ok: [an-striker02]
[2026-04-16T01:51:33.973Z] ok: [an-striker01]
[2026-04-16T01:51:33.973Z] 
[2026-04-16T01:51:33.973Z] TASK [wait up to 30 minutes for all images to be propagated to all nodes] ******
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (180 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (179 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (178 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (177 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (176 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (175 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (174 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (173 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (172 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker01]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for all images to be propagated to all nodes (171 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for all images to be propagated to all nodes (170 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for all images to be propagated to all nodes (170 retries left).
[2026-04-16T01:53:43.305Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for all images to be propagated to all nodes (170 retries left).
[2026-04-16T01:53:43.305Z] ok: [an-striker01]
[2026-04-16T01:53:43.305Z] ok: [an-striker02]
[2026-04-16T01:53:43.305Z] ok: [an-a01dr01]
[2026-04-16T01:53:43.305Z] ok: [an-a01n02]
[2026-04-16T01:53:43.305Z] ok: [an-a01n01]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] PLAY [example tests] ***********************************************************
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:53:43.305Z] ok: [an-a01n01]
[2026-04-16T01:53:43.305Z] ok: [an-a01dr01]
[2026-04-16T01:53:43.305Z] ok: [an-a01n02]
[2026-04-16T01:53:43.305Z] ok: [an-striker02]
[2026-04-16T01:53:43.305Z] ok: [an-striker01]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [this test should be executed only on strikers] ***************************
[2026-04-16T01:53:43.305Z] skipping: [an-a01n01]
[2026-04-16T01:53:43.305Z] skipping: [an-a01n02]
[2026-04-16T01:53:43.305Z] skipping: [an-a01dr01]
[2026-04-16T01:53:43.305Z] ok: [an-striker02]
[2026-04-16T01:53:43.305Z] ok: [an-striker01]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [this test should be executed only on non strikers] ***********************
[2026-04-16T01:53:43.305Z] skipping: [an-striker01]
[2026-04-16T01:53:43.305Z] skipping: [an-striker02]
[2026-04-16T01:53:43.305Z] ok: [an-a01n01]
[2026-04-16T01:53:43.305Z] ok: [an-a01dr01]
[2026-04-16T01:53:43.305Z] ok: [an-a01n02]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [inject failure] **********************************************************
[2026-04-16T01:53:43.305Z] skipping: [an-striker01]
[2026-04-16T01:53:43.305Z] skipping: [an-striker02]
[2026-04-16T01:53:43.305Z] skipping: [an-a01n01]
[2026-04-16T01:53:43.305Z] skipping: [an-a01n02]
[2026-04-16T01:53:43.305Z] skipping: [an-a01dr01]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] PLAY [Record anvil available resources from striker01] *************************
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:53:43.305Z] ok: [an-striker01]
[2026-04-16T01:53:43.305Z] 
[2026-04-16T01:53:43.305Z] TASK [Record anvil available resources] ****************************************
[2026-04-16T01:53:44.573Z] ok: [an-striker01]
[2026-04-16T01:53:44.573Z] 
[2026-04-16T01:53:44.573Z] PLAY [check selinux status] ****************************************************
[2026-04-16T01:53:44.573Z] 
[2026-04-16T01:53:44.573Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:53:47.030Z] ok: [an-a01dr01]
[2026-04-16T01:53:47.030Z] ok: [an-a01n01]
[2026-04-16T01:53:47.030Z] ok: [an-a01n02]
[2026-04-16T01:53:47.030Z] ok: [an-striker02]
[2026-04-16T01:53:47.030Z] ok: [an-striker01]
[2026-04-16T01:53:47.030Z] 
[2026-04-16T01:53:47.030Z] TASK [check selinux status permissive (8)] *************************************
[2026-04-16T01:53:47.398Z] skipping: [an-striker01]
[2026-04-16T01:53:47.398Z] skipping: [an-striker02]
[2026-04-16T01:53:47.398Z] skipping: [an-a01n01]
[2026-04-16T01:53:47.398Z] skipping: [an-a01n02]
[2026-04-16T01:53:47.398Z] skipping: [an-a01dr01]
[2026-04-16T01:53:47.398Z] 
[2026-04-16T01:53:47.398Z] TASK [check selinux status permissive (9)] *************************************
[2026-04-16T01:53:47.768Z] ok: [an-striker01] => {
[2026-04-16T01:53:47.768Z]     "ansible_selinux": {
[2026-04-16T01:53:47.768Z]         "config_mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "policyvers": 33,
[2026-04-16T01:53:47.768Z]         "status": "enabled",
[2026-04-16T01:53:47.768Z]         "type": "targeted"
[2026-04-16T01:53:47.768Z]     },
[2026-04-16T01:53:47.768Z]     "failed_when_result": false
[2026-04-16T01:53:47.768Z] }
[2026-04-16T01:53:47.768Z] ok: [an-striker02] => {
[2026-04-16T01:53:47.768Z]     "ansible_selinux": {
[2026-04-16T01:53:47.768Z]         "config_mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "policyvers": 33,
[2026-04-16T01:53:47.768Z]         "status": "enabled",
[2026-04-16T01:53:47.768Z]         "type": "targeted"
[2026-04-16T01:53:47.768Z]     },
[2026-04-16T01:53:47.768Z]     "failed_when_result": false
[2026-04-16T01:53:47.768Z] }
[2026-04-16T01:53:47.768Z] ok: [an-a01n01] => {
[2026-04-16T01:53:47.768Z]     "ansible_selinux": {
[2026-04-16T01:53:47.768Z]         "config_mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "policyvers": 33,
[2026-04-16T01:53:47.768Z]         "status": "enabled",
[2026-04-16T01:53:47.768Z]         "type": "targeted"
[2026-04-16T01:53:47.768Z]     },
[2026-04-16T01:53:47.768Z]     "failed_when_result": false
[2026-04-16T01:53:47.768Z] }
[2026-04-16T01:53:47.768Z] ok: [an-a01n02] => {
[2026-04-16T01:53:47.768Z]     "ansible_selinux": {
[2026-04-16T01:53:47.768Z]         "config_mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "policyvers": 33,
[2026-04-16T01:53:47.768Z]         "status": "enabled",
[2026-04-16T01:53:47.768Z]         "type": "targeted"
[2026-04-16T01:53:47.768Z]     },
[2026-04-16T01:53:47.768Z]     "failed_when_result": false
[2026-04-16T01:53:47.768Z] }
[2026-04-16T01:53:47.768Z] ok: [an-a01dr01] => {
[2026-04-16T01:53:47.768Z]     "ansible_selinux": {
[2026-04-16T01:53:47.768Z]         "config_mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "mode": "enforcing",
[2026-04-16T01:53:47.768Z]         "policyvers": 33,
[2026-04-16T01:53:47.768Z]         "status": "enabled",
[2026-04-16T01:53:47.768Z]         "type": "targeted"
[2026-04-16T01:53:47.768Z]     },
[2026-04-16T01:53:47.768Z]     "failed_when_result": false
[2026-04-16T01:53:47.768Z] }
[2026-04-16T01:53:47.768Z] 
[2026-04-16T01:53:47.768Z] PLAY [Create random file on striker01] *****************************************
[2026-04-16T01:53:47.768Z] 
[2026-04-16T01:53:47.768Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:53:49.587Z] ok: [an-striker01]
[2026-04-16T01:53:49.587Z] 
[2026-04-16T01:53:49.587Z] TASK [Create archive file] *****************************************************
[2026-04-16T01:53:52.784Z] changed: [an-striker01]
[2026-04-16T01:53:52.784Z] 
[2026-04-16T01:53:52.784Z] PLAY [Check archive file propagation] ******************************************
[2026-04-16T01:53:52.784Z] 
[2026-04-16T01:53:52.784Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:53:54.603Z] ok: [an-a01n01]
[2026-04-16T01:53:54.603Z] ok: [an-a01dr01]
[2026-04-16T01:53:54.603Z] ok: [an-a01n02]
[2026-04-16T01:53:54.603Z] ok: [an-striker01]
[2026-04-16T01:53:54.603Z] ok: [an-striker02]
[2026-04-16T01:53:54.603Z] 
[2026-04-16T01:53:54.603Z] TASK [wait up to 30 minutes for archive to be propagated to all nodes] *********
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (180 retries left).
[2026-04-16T01:54:23.051Z] ok: [an-striker01]
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01dr01]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01n02]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-a01n01]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left).
[2026-04-16T01:54:23.051Z] FAILED - RETRYING: [an-striker02]: wait up to 30 minutes for archive to be propagated to all nodes (179 retries left).
[2026-04-16T01:54:23.051Z] ok: [an-a01dr01]
[2026-04-16T01:54:23.051Z] ok: [an-a01n02]
[2026-04-16T01:54:23.051Z] ok: [an-a01n01]
[2026-04-16T01:54:23.051Z] ok: [an-striker02]
[2026-04-16T01:54:23.051Z] 
[2026-04-16T01:54:23.051Z] PLAY [test fencing] ************************************************************
[2026-04-16T01:54:23.051Z] 
[2026-04-16T01:54:23.051Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T01:54:23.051Z] ok: [an-a01n01]
[2026-04-16T01:54:23.051Z] ok: [an-a01n02]
[2026-04-16T01:54:23.051Z] 
[2026-04-16T01:54:23.051Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T01:54:23.051Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T01:54:23.051Z] 
[2026-04-16T01:54:23.051Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T01:54:24.318Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T01:54:24.318Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T01:54:24.318Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T01:54:24.318Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T01:54:24.318Z] 
[2026-04-16T01:54:24.318Z] TASK [kill node "an-a01n01"] ***************************************************
[2026-04-16T01:54:24.318Z] included: /srv/anvil/anvil-test-suite/playbooks/common/kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T01:54:24.318Z] 
[2026-04-16T01:54:24.318Z] TASK [kill node "an-a01n01"] ***************************************************
[2026-04-16T01:54:25.583Z] skipping: [an-a01n02]
[2026-04-16T01:54:25.583Z] changed: [an-a01n01]
[2026-04-16T01:54:25.583Z] 
[2026-04-16T01:54:25.583Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T01:54:25.583Z] skipping: [an-a01n02]
[2026-04-16T01:54:25.583Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01
[2026-04-16T01:54:25.583Z] 
[2026-04-16T01:54:25.583Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T01:57:50.592Z] ok: [an-a01n01 -> localhost]
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T01:57:50.592Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T01:57:50.592Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T01:57:50.592Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T01:57:50.592Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T01:57:50.592Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [kill node "an-a01n02"] ***************************************************
[2026-04-16T01:57:50.592Z] included: /srv/anvil/anvil-test-suite/playbooks/common/kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [kill node "an-a01n02"] ***************************************************
[2026-04-16T01:57:50.592Z] skipping: [an-a01n01]
[2026-04-16T01:57:50.592Z] changed: [an-a01n02]
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T01:57:50.592Z] skipping: [an-a01n01]
[2026-04-16T01:57:50.592Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n02
[2026-04-16T01:57:50.592Z] 
[2026-04-16T01:57:50.592Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T02:01:00.618Z] ok: [an-a01n02 -> localhost]
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:01:00.618Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:01:00.618Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:01:00.618Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:01:00.618Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:01:00.618Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] PLAY [advanced server tests] ***************************************************
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T02:01:00.618Z] ok: [an-a01n02]
[2026-04-16T02:01:00.618Z] ok: [an-a01n01]
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:01:00.618Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:01:00.618Z] 
[2026-04-16T02:01:00.618Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:01:01.889Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:01:01.889Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:01:01.889Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:01:01.889Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:01:01.889Z] 
[2026-04-16T02:01:01.889Z] TASK [check anvil-provision-server storage group] ******************************
[2026-04-16T02:01:01.889Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_storage_group.yml for an-a01n01, an-a01n02
[2026-04-16T02:01:01.889Z] 
[2026-04-16T02:01:01.889Z] TASK [get anvil-provision-server storage group] ********************************
[2026-04-16T02:01:08.159Z] changed: [an-a01n01]
[2026-04-16T02:01:08.159Z] changed: [an-a01n02]
[2026-04-16T02:01:08.159Z] 
[2026-04-16T02:01:08.159Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T02:01:08.159Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_install_iso.yml for an-a01n01, an-a01n02
[2026-04-16T02:01:08.159Z] 
[2026-04-16T02:01:08.159Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T02:01:13.233Z] changed: [an-a01n01]
[2026-04-16T02:01:13.233Z] changed: [an-a01n02]
[2026-04-16T02:01:13.233Z] 
[2026-04-16T02:01:13.233Z] TASK [deploy servers] **********************************************************
[2026-04-16T02:01:13.233Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:01:13.233Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:01:13.233Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:01:13.233Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:01:13.233Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:01:13.233Z] 
[2026-04-16T02:01:13.233Z] TASK [check if server an-test-deploy1 exists] **********************************
[2026-04-16T02:01:15.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:15.051Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy1\n", "delta": "0:00:00.909440", "end": "2026-04-15 22:01:14.410841", "msg": "non-zero return code", "rc": 1, "start": "2026-04-15 22:01:13.501401", "stderr": "Error: resource or tag id 'an-test-deploy1' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy1' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T02:01:15.051Z] ...ignoring
[2026-04-16T02:01:15.051Z] 
[2026-04-16T02:01:15.051Z] TASK [deploy server an-test-deploy1 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T02:01:24.388Z] skipping: [an-a01n02]
[2026-04-16T02:01:24.388Z] changed: [an-a01n01]
[2026-04-16T02:01:24.388Z] 
[2026-04-16T02:01:24.388Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker] ***
[2026-04-16T02:01:24.388Z] skipping: [an-a01n01]
[2026-04-16T02:01:24.388Z] skipping: [an-a01n02]
[2026-04-16T02:01:24.388Z] 
[2026-04-16T02:01:24.388Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced] ***
[2026-04-16T02:01:24.388Z] skipping: [an-a01n01]
[2026-04-16T02:01:24.388Z] skipping: [an-a01n02]
[2026-04-16T02:01:24.388Z] 
[2026-04-16T02:01:24.388Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation] ***
[2026-04-16T02:01:24.388Z] skipping: [an-a01n01]
[2026-04-16T02:01:24.388Z] skipping: [an-a01n02]
[2026-04-16T02:01:24.388Z] 
[2026-04-16T02:01:24.388Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation] ***
[2026-04-16T02:01:24.388Z] skipping: [an-a01n01]
[2026-04-16T02:01:24.388Z] skipping: [an-a01n02]
[2026-04-16T02:01:24.388Z] 
[2026-04-16T02:01:24.388Z] TASK [check if server an-test-deploy2 exists] **********************************
[2026-04-16T02:01:25.177Z] skipping: [an-a01n02]
[2026-04-16T02:01:25.177Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy2\n", "delta": "0:00:00.889458", "end": "2026-04-15 22:01:25.016592", "msg": "non-zero return code", "rc": 1, "start": "2026-04-15 22:01:24.127134", "stderr": "Error: resource or tag id 'an-test-deploy2' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy2' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T02:01:25.177Z] ...ignoring
[2026-04-16T02:01:25.177Z] 
[2026-04-16T02:01:25.177Z] TASK [deploy server an-test-deploy2 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T02:01:34.611Z] skipping: [an-a01n02]
[2026-04-16T02:01:34.611Z] changed: [an-a01n01]
[2026-04-16T02:01:34.611Z] 
[2026-04-16T02:01:34.611Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker] ***
[2026-04-16T02:01:34.611Z] skipping: [an-a01n01]
[2026-04-16T02:01:34.611Z] skipping: [an-a01n02]
[2026-04-16T02:01:34.611Z] 
[2026-04-16T02:01:34.611Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced] ***
[2026-04-16T02:01:34.611Z] skipping: [an-a01n01]
[2026-04-16T02:01:34.611Z] skipping: [an-a01n02]
[2026-04-16T02:01:34.611Z] 
[2026-04-16T02:01:34.611Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation] ***
[2026-04-16T02:01:34.611Z] skipping: [an-a01n01]
[2026-04-16T02:01:34.611Z] skipping: [an-a01n02]
[2026-04-16T02:01:34.611Z] 
[2026-04-16T02:01:34.611Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation] ***
[2026-04-16T02:01:34.981Z] skipping: [an-a01n01]
[2026-04-16T02:01:34.981Z] skipping: [an-a01n02]
[2026-04-16T02:01:34.981Z] 
[2026-04-16T02:01:34.981Z] TASK [check if server an-test-deploy3 exists] **********************************
[2026-04-16T02:01:36.248Z] skipping: [an-a01n02]
[2026-04-16T02:01:36.248Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy3\n", "delta": "0:00:00.939285", "end": "2026-04-15 22:01:36.120014", "msg": "non-zero return code", "rc": 1, "start": "2026-04-15 22:01:35.180729", "stderr": "Error: resource or tag id 'an-test-deploy3' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy3' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T02:01:36.248Z] ...ignoring
[2026-04-16T02:01:36.248Z] 
[2026-04-16T02:01:36.248Z] TASK [deploy server an-test-deploy3 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T02:01:46.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:46.051Z] changed: [an-a01n01]
[2026-04-16T02:01:46.051Z] 
[2026-04-16T02:01:46.051Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker] ***
[2026-04-16T02:01:46.051Z] skipping: [an-a01n01]
[2026-04-16T02:01:46.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:46.051Z] 
[2026-04-16T02:01:46.051Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced] ***
[2026-04-16T02:01:46.051Z] skipping: [an-a01n01]
[2026-04-16T02:01:46.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:46.051Z] 
[2026-04-16T02:01:46.051Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation] ***
[2026-04-16T02:01:46.051Z] skipping: [an-a01n01]
[2026-04-16T02:01:46.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:46.051Z] 
[2026-04-16T02:01:46.051Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation] ***
[2026-04-16T02:01:46.051Z] skipping: [an-a01n01]
[2026-04-16T02:01:46.051Z] skipping: [an-a01n02]
[2026-04-16T02:01:46.051Z] 
[2026-04-16T02:01:46.051Z] TASK [check if server an-test-deploy4 exists] **********************************
[2026-04-16T02:01:47.318Z] skipping: [an-a01n02]
[2026-04-16T02:01:47.318Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy4\n", "delta": "0:00:01.011788", "end": "2026-04-15 22:01:47.027009", "msg": "non-zero return code", "rc": 1, "start": "2026-04-15 22:01:46.015221", "stderr": "Error: resource or tag id 'an-test-deploy4' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy4' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T02:01:47.318Z] ...ignoring
[2026-04-16T02:01:47.318Z] 
[2026-04-16T02:01:47.318Z] TASK [deploy server an-test-deploy4 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T02:01:58.631Z] skipping: [an-a01n02]
[2026-04-16T02:01:58.631Z] changed: [an-a01n01]
[2026-04-16T02:01:58.631Z] 
[2026-04-16T02:01:58.631Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker] ***
[2026-04-16T02:01:58.631Z] skipping: [an-a01n01]
[2026-04-16T02:01:58.631Z] skipping: [an-a01n02]
[2026-04-16T02:01:58.631Z] 
[2026-04-16T02:01:58.631Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced] ***
[2026-04-16T02:01:58.631Z] skipping: [an-a01n01]
[2026-04-16T02:01:58.631Z] skipping: [an-a01n02]
[2026-04-16T02:01:58.631Z] 
[2026-04-16T02:01:58.631Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation] ***
[2026-04-16T02:01:58.631Z] skipping: [an-a01n01]
[2026-04-16T02:01:58.631Z] skipping: [an-a01n02]
[2026-04-16T02:01:58.631Z] 
[2026-04-16T02:01:58.631Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation] ***
[2026-04-16T02:01:58.631Z] skipping: [an-a01n01]
[2026-04-16T02:01:58.631Z] skipping: [an-a01n02]
[2026-04-16T02:01:58.631Z] 
[2026-04-16T02:01:58.631Z] TASK [check if server an-test-deploy5 exists] **********************************
[2026-04-16T02:01:59.000Z] skipping: [an-a01n02]
[2026-04-16T02:01:59.000Z] fatal: [an-a01n01]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy5\n", "delta": "0:00:00.980311", "end": "2026-04-15 22:01:58.655726", "msg": "non-zero return code", "rc": 1, "start": "2026-04-15 22:01:57.675415", "stderr": "Error: resource or tag id 'an-test-deploy5' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy5' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T02:01:59.000Z] ...ignoring
[2026-04-16T02:01:59.000Z] 
[2026-04-16T02:01:59.000Z] TASK [deploy server an-test-deploy5 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T02:02:10.303Z] skipping: [an-a01n02]
[2026-04-16T02:02:10.303Z] changed: [an-a01n01]
[2026-04-16T02:02:10.303Z] 
[2026-04-16T02:02:10.303Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to be started in pacemaker] ***
[2026-04-16T02:02:10.303Z] skipping: [an-a01n01]
[2026-04-16T02:02:10.303Z] skipping: [an-a01n02]
[2026-04-16T02:02:10.303Z] 
[2026-04-16T02:02:10.303Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} drbd storage to be synced] ***
[2026-04-16T02:02:10.303Z] skipping: [an-a01n01]
[2026-04-16T02:02:10.303Z] skipping: [an-a01n02]
[2026-04-16T02:02:10.303Z] 
[2026-04-16T02:02:10.303Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to start installation] ***
[2026-04-16T02:02:10.303Z] skipping: [an-a01n01]
[2026-04-16T02:02:10.303Z] skipping: [an-a01n02]
[2026-04-16T02:02:10.303Z] 
[2026-04-16T02:02:10.303Z] TASK [Wait up to {{ timeout }} minutes for an-test-deploy{{ servernum }} to complete installation] ***
[2026-04-16T02:02:10.303Z] skipping: [an-a01n01]
[2026-04-16T02:02:10.303Z] skipping: [an-a01n02]
[2026-04-16T02:02:10.303Z] 
[2026-04-16T02:02:10.303Z] TASK [wait servers to be started in pacemaker] *********************************
[2026-04-16T02:02:10.673Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:02:10.673Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:02:10.673Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:02:10.673Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:02:10.673Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:02:10.673Z] 
[2026-04-16T02:02:10.673Z] TASK [Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker] ****
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (360 retries left).
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (360 retries left).
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (359 retries left).
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (359 retries left).
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (358 retries left).
[2026-04-16T02:02:51.559Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 to be started in pacemaker (358 retries left).
[2026-04-16T02:02:51.559Z] ok: [an-a01n02]
[2026-04-16T02:02:51.559Z] ok: [an-a01n01]
[2026-04-16T02:02:51.559Z] 
[2026-04-16T02:02:51.559Z] TASK [Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker] ****
[2026-04-16T02:04:46.154Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (360 retries left).
[2026-04-16T02:04:46.154Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (360 retries left).
[2026-04-16T02:04:46.154Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (359 retries left).
[2026-04-16T02:04:46.154Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (359 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (358 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (358 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (357 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (357 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (356 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (356 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (355 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (355 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (354 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (354 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (353 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (353 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (352 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (352 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (351 retries left).
[2026-04-16T02:04:46.155Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to be started in pacemaker (351 retries left).
[2026-04-16T02:04:46.155Z] ok: [an-a01n02]
[2026-04-16T02:04:46.155Z] ok: [an-a01n01]
[2026-04-16T02:04:46.155Z] 
[2026-04-16T02:04:46.155Z] TASK [Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker] ****
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (360 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (360 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (359 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (359 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (358 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (358 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (357 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (357 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (356 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (356 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (355 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (355 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (354 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (354 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (353 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (353 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (352 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (352 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (351 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (351 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (350 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (350 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (349 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (349 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (348 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (348 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (347 retries left).
[2026-04-16T02:07:40.969Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to be started in pacemaker (347 retries left).
[2026-04-16T02:07:40.969Z] ok: [an-a01n02]
[2026-04-16T02:07:40.969Z] ok: [an-a01n01]
[2026-04-16T02:07:40.969Z] 
[2026-04-16T02:07:40.969Z] TASK [Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker] ****
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (360 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (360 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (359 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (359 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (358 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (358 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (357 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (357 retries left).
[2026-04-16T02:10:20.593Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (356 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (356 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (355 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (355 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (354 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (354 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (353 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (353 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (352 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (352 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (351 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (351 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (350 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (350 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (349 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (349 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (348 retries left).
[2026-04-16T02:10:20.594Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to be started in pacemaker (348 retries left).
[2026-04-16T02:10:20.594Z] ok: [an-a01n02]
[2026-04-16T02:10:20.594Z] ok: [an-a01n01]
[2026-04-16T02:10:20.594Z] 
[2026-04-16T02:10:20.594Z] TASK [Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker] ****
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (360 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (360 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (359 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (359 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (358 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (358 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (357 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (357 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (356 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (356 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (355 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (355 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (354 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (354 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (353 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (353 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (352 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (352 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (351 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (351 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (350 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (350 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (349 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (349 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (348 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (347 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (348 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (346 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (347 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (345 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (346 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (344 retries left).
[2026-04-16T02:13:30.411Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to be started in pacemaker (345 retries left).
[2026-04-16T02:13:30.411Z] ok: [an-a01n02]
[2026-04-16T02:13:30.411Z] ok: [an-a01n01]
[2026-04-16T02:13:30.411Z] 
[2026-04-16T02:13:30.411Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T02:13:30.411Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:13:30.411Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:13:30.411Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:13:30.411Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:13:30.411Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:13:30.411Z] 
[2026-04-16T02:13:30.411Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T02:13:31.707Z] ok: [an-a01n01]
[2026-04-16T02:13:31.707Z] ok: [an-a01n02]
[2026-04-16T02:13:31.707Z] 
[2026-04-16T02:13:31.707Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T02:13:33.525Z] ok: [an-a01n02]
[2026-04-16T02:13:33.525Z] ok: [an-a01n01]
[2026-04-16T02:13:33.525Z] 
[2026-04-16T02:13:33.525Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T02:13:34.312Z] ok: [an-a01n01]
[2026-04-16T02:13:34.312Z] ok: [an-a01n02]
[2026-04-16T02:13:34.312Z] 
[2026-04-16T02:13:34.312Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T02:13:35.101Z] ok: [an-a01n01]
[2026-04-16T02:13:35.101Z] ok: [an-a01n02]
[2026-04-16T02:13:35.101Z] 
[2026-04-16T02:13:35.101Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (360 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (360 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (359 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (359 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (358 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (358 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (357 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (357 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (356 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (356 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (355 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (355 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (354 retries left).
[2026-04-16T02:14:59.111Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (354 retries left).
[2026-04-16T02:14:59.111Z] ok: [an-a01n02]
[2026-04-16T02:14:59.111Z] ok: [an-a01n01]
[2026-04-16T02:14:59.111Z] 
[2026-04-16T02:14:59.111Z] TASK [wait servers to respond to ping] *****************************************
[2026-04-16T02:14:59.111Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n02, an-a01n01 => (item=1)
[2026-04-16T02:14:59.111Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n02, an-a01n01 => (item=2)
[2026-04-16T02:14:59.111Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n02, an-a01n01 => (item=3)
[2026-04-16T02:14:59.111Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n02, an-a01n01 => (item=4)
[2026-04-16T02:14:59.111Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n02, an-a01n01 => (item=5)
[2026-04-16T02:14:59.111Z] 
[2026-04-16T02:14:59.111Z] TASK [Wait up to 60 minutes for an-test-deploy1 to respond to ping] ************
[2026-04-16T02:14:59.111Z] ok: [an-a01n01]
[2026-04-16T02:14:59.111Z] ok: [an-a01n02]
[2026-04-16T02:14:59.111Z] 
[2026-04-16T02:14:59.111Z] TASK [Wait up to 60 minutes for an-test-deploy2 to respond to ping] ************
[2026-04-16T02:14:59.111Z] ok: [an-a01n01]
[2026-04-16T02:14:59.111Z] ok: [an-a01n02]
[2026-04-16T02:14:59.111Z] 
[2026-04-16T02:14:59.111Z] TASK [Wait up to 60 minutes for an-test-deploy3 to respond to ping] ************
[2026-04-16T02:14:59.111Z] ok: [an-a01n02]
[2026-04-16T02:14:59.111Z] ok: [an-a01n01]
[2026-04-16T02:14:59.111Z] 
[2026-04-16T02:14:59.111Z] TASK [Wait up to 60 minutes for an-test-deploy4 to respond to ping] ************
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (360 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (360 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (359 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (359 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (358 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (358 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (357 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (357 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (356 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (356 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (355 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (355 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (354 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (354 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (353 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (353 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (352 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (352 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (351 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (351 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (350 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (350 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (349 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (349 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (348 retries left).
[2026-04-16T02:18:08.921Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ping (348 retries left).
[2026-04-16T02:18:08.921Z] ok: [an-a01n02]
[2026-04-16T02:18:08.921Z] ok: [an-a01n01]
[2026-04-16T02:18:08.921Z] 
[2026-04-16T02:18:08.921Z] TASK [Wait up to 60 minutes for an-test-deploy5 to respond to ping] ************
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (360 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (360 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (359 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (359 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (358 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (358 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (357 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (357 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (356 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (356 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (355 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (355 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (354 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (354 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (353 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (353 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (352 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (352 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (351 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (351 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (350 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (350 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (349 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (349 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (348 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (348 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (347 retries left).
[2026-04-16T02:21:20.099Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ping (347 retries left).
[2026-04-16T02:21:20.099Z] ok: [an-a01n02]
[2026-04-16T02:21:20.099Z] ok: [an-a01n01]
[2026-04-16T02:21:20.099Z] 
[2026-04-16T02:21:20.099Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:21:20.099Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:21:20.099Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:21:20.099Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:21:20.099Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:21:20.099Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:21:20.099Z] 
[2026-04-16T02:21:20.099Z] TASK [Wait up to 60 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:21:20.099Z] ok: [an-a01n01]
[2026-04-16T02:21:20.099Z] ok: [an-a01n02]
[2026-04-16T02:21:20.099Z] 
[2026-04-16T02:21:20.099Z] TASK [Wait up to 60 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (360 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (360 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (359 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (359 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (358 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (358 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (357 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (357 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (356 retries left).
[2026-04-16T02:22:30.205Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy2 to respond to ssh (356 retries left).
[2026-04-16T02:22:30.205Z] ok: [an-a01n01]
[2026-04-16T02:22:30.205Z] ok: [an-a01n02]
[2026-04-16T02:22:30.205Z] 
[2026-04-16T02:22:30.205Z] TASK [Wait up to 60 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (360 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (360 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (359 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (359 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (358 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (358 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (357 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (357 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (356 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (356 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (355 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (355 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (354 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (354 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (353 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (353 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (352 retries left).
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (352 retries left).
[2026-04-16T02:24:39.534Z] ok: [an-a01n01]
[2026-04-16T02:24:39.534Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy3 to respond to ssh (351 retries left).
[2026-04-16T02:24:39.534Z] ok: [an-a01n02]
[2026-04-16T02:24:39.534Z] 
[2026-04-16T02:24:39.534Z] TASK [Wait up to 60 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (360 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (360 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (359 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (359 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (358 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (358 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (357 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (357 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (356 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (356 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (355 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (355 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (354 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (354 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (353 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (353 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (352 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (352 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (351 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (351 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (350 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (350 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (349 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (349 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (348 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (348 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (347 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (347 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (346 retries left).
[2026-04-16T02:27:49.376Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy4 to respond to ssh (346 retries left).
[2026-04-16T02:27:49.376Z] ok: [an-a01n02]
[2026-04-16T02:27:49.376Z] ok: [an-a01n01]
[2026-04-16T02:27:49.376Z] 
[2026-04-16T02:27:49.376Z] TASK [Wait up to 60 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (360 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (360 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (359 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (359 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (358 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (358 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (357 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (357 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (356 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (356 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (355 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (355 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (354 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (354 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (353 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (353 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (352 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (352 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (351 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (351 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (350 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (350 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (349 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (349 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (348 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (348 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (347 retries left).
[2026-04-16T02:30:28.993Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 to respond to ssh (347 retries left).
[2026-04-16T02:30:28.993Z] ok: [an-a01n02]
[2026-04-16T02:30:28.993Z] ok: [an-a01n01]
[2026-04-16T02:30:28.993Z] 
[2026-04-16T02:30:28.993Z] TASK [fence with servers test] *************************************************
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/common/fence_with_servers.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/common/fence_with_servers.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/common/fence_with_servers.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/common/fence_with_servers.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/common/fence_with_servers.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:30:28.993Z] 
[2026-04-16T02:30:28.993Z] TASK [fence with servers iteration 1] ******************************************
[2026-04-16T02:30:28.993Z] ok: [an-a01n01]
[2026-04-16T02:30:28.993Z] ok: [an-a01n02]
[2026-04-16T02:30:28.993Z] 
[2026-04-16T02:30:28.993Z] TASK [check servers status] ****************************************************
[2026-04-16T02:30:28.993Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01, an-a01n02
[2026-04-16T02:30:28.993Z] 
[2026-04-16T02:30:28.993Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:30:28.993Z] ok: [an-a01n02]
[2026-04-16T02:30:28.993Z] ok: [an-a01n01]
[2026-04-16T02:30:28.993Z] 
[2026-04-16T02:30:28.993Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:30:30.263Z] ok: [an-a01n02]
[2026-04-16T02:30:30.263Z] ok: [an-a01n01]
[2026-04-16T02:30:30.263Z] 
[2026-04-16T02:30:30.263Z] TASK [set target] **************************************************************
[2026-04-16T02:30:30.263Z] ok: [an-a01n01]
[2026-04-16T02:30:30.263Z] ok: [an-a01n02]
[2026-04-16T02:30:30.263Z] 
[2026-04-16T02:30:30.263Z] TASK [will kill node with servers] *********************************************
[2026-04-16T02:30:30.263Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:30:30.263Z] 
[2026-04-16T02:30:30.263Z] TASK [kill node "an-a01n01"] ***************************************************
[2026-04-16T02:30:31.051Z] skipping: [an-a01n02]
[2026-04-16T02:30:31.051Z] changed: [an-a01n01]
[2026-04-16T02:30:31.051Z] 
[2026-04-16T02:30:31.051Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T02:30:31.051Z] skipping: [an-a01n01]
[2026-04-16T02:30:31.051Z] skipping: [an-a01n02]
[2026-04-16T02:30:31.051Z] 
[2026-04-16T02:30:31.051Z] TASK [wait for node to be offline] *********************************************
[2026-04-16T02:30:31.051Z] skipping: [an-a01n01]
[2026-04-16T02:30:31.051Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./offline_node.yml for an-a01n02
[2026-04-16T02:30:31.051Z] 
[2026-04-16T02:30:31.051Z] TASK [wait up to 10 minutes for node an-a01n01 to be offline] ******************
[2026-04-16T02:31:41.282Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (60 retries left).
[2026-04-16T02:31:41.282Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (59 retries left).
[2026-04-16T02:31:41.282Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (58 retries left).
[2026-04-16T02:31:41.282Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (57 retries left).
[2026-04-16T02:31:41.282Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (56 retries left).
[2026-04-16T02:31:41.282Z] ok: [an-a01n02]
[2026-04-16T02:31:41.282Z] 
[2026-04-16T02:31:41.282Z] TASK [check servers status] ****************************************************
[2026-04-16T02:31:41.282Z] skipping: [an-a01n01]
[2026-04-16T02:31:41.282Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n02
[2026-04-16T02:31:41.282Z] 
[2026-04-16T02:31:41.282Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (120 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (119 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (118 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (117 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (116 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (115 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (114 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (113 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (112 retries left).
[2026-04-16T02:33:50.721Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (111 retries left).
[2026-04-16T02:33:50.721Z] ok: [an-a01n02]
[2026-04-16T02:33:50.721Z] 
[2026-04-16T02:33:50.721Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:33:50.721Z] ok: [an-a01n02]
[2026-04-16T02:33:50.721Z] 
[2026-04-16T02:33:50.721Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01] => (item=1) 
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01] => (item=2) 
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01] => (item=3) 
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01] => (item=4) 
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01] => (item=5) 
[2026-04-16T02:33:50.721Z] skipping: [an-a01n01]
[2026-04-16T02:33:50.721Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=1)
[2026-04-16T02:33:50.721Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=2)
[2026-04-16T02:33:50.721Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=3)
[2026-04-16T02:33:50.721Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=4)
[2026-04-16T02:33:50.721Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=5)
[2026-04-16T02:33:50.721Z] 
[2026-04-16T02:33:50.721Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:34:02.126Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to respond to ssh (60 retries left).
[2026-04-16T02:34:02.126Z] ok: [an-a01n02]
[2026-04-16T02:34:02.126Z] 
[2026-04-16T02:34:02.126Z] TASK [Wait up to 10 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:34:02.126Z] ok: [an-a01n02]
[2026-04-16T02:34:02.126Z] 
[2026-04-16T02:34:02.126Z] TASK [Wait up to 10 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:34:02.917Z] ok: [an-a01n02]
[2026-04-16T02:34:02.917Z] 
[2026-04-16T02:34:02.917Z] TASK [Wait up to 10 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:34:04.183Z] ok: [an-a01n02]
[2026-04-16T02:34:04.183Z] 
[2026-04-16T02:34:04.183Z] TASK [Wait up to 10 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:34:04.972Z] ok: [an-a01n02]
[2026-04-16T02:34:04.972Z] 
[2026-04-16T02:34:04.972Z] TASK [wait for node to be back online] *****************************************
[2026-04-16T02:34:04.972Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:34:04.972Z] 
[2026-04-16T02:34:04.972Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T02:37:30.081Z] ok: [an-a01n02 -> localhost]
[2026-04-16T02:37:30.081Z] ok: [an-a01n01 -> localhost]
[2026-04-16T02:37:30.081Z] 
[2026-04-16T02:37:30.081Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:37:30.081Z] 
[2026-04-16T02:37:30.081Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:37:30.081Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:37:30.081Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:37:30.081Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:37:30.081Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:37:30.081Z] 
[2026-04-16T02:37:30.081Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:37:30.081Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:37:30.081Z] 
[2026-04-16T02:37:30.081Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (360 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (360 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (359 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (359 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (358 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (358 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (357 retries left).
[2026-04-16T02:38:04.184Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (357 retries left).
[2026-04-16T02:38:04.184Z] ok: [an-a01n01]
[2026-04-16T02:38:04.184Z] ok: [an-a01n02]
[2026-04-16T02:38:04.184Z] 
[2026-04-16T02:38:04.184Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T02:38:04.973Z] ok: [an-a01n01]
[2026-04-16T02:38:04.973Z] ok: [an-a01n02]
[2026-04-16T02:38:04.973Z] 
[2026-04-16T02:38:04.973Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T02:38:05.765Z] ok: [an-a01n01]
[2026-04-16T02:38:05.765Z] ok: [an-a01n02]
[2026-04-16T02:38:05.765Z] 
[2026-04-16T02:38:05.765Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T02:38:06.553Z] ok: [an-a01n01]
[2026-04-16T02:38:06.553Z] ok: [an-a01n02]
[2026-04-16T02:38:06.553Z] 
[2026-04-16T02:38:06.553Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T02:38:08.458Z] ok: [an-a01n01]
[2026-04-16T02:38:08.458Z] ok: [an-a01n02]
[2026-04-16T02:38:08.458Z] 
[2026-04-16T02:38:08.458Z] TASK [fence with servers iteration 2] ******************************************
[2026-04-16T02:38:08.458Z] ok: [an-a01n01]
[2026-04-16T02:38:08.458Z] ok: [an-a01n02]
[2026-04-16T02:38:08.458Z] 
[2026-04-16T02:38:08.458Z] TASK [check servers status] ****************************************************
[2026-04-16T02:38:08.458Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01, an-a01n02
[2026-04-16T02:38:08.458Z] 
[2026-04-16T02:38:08.458Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:38:09.459Z] ok: [an-a01n01]
[2026-04-16T02:38:09.459Z] ok: [an-a01n02]
[2026-04-16T02:38:09.459Z] 
[2026-04-16T02:38:09.459Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:38:11.813Z] ok: [an-a01n02]
[2026-04-16T02:38:11.813Z] ok: [an-a01n01]
[2026-04-16T02:38:11.813Z] 
[2026-04-16T02:38:11.813Z] TASK [set target] **************************************************************
[2026-04-16T02:38:11.813Z] ok: [an-a01n01]
[2026-04-16T02:38:11.813Z] ok: [an-a01n02]
[2026-04-16T02:38:11.813Z] 
[2026-04-16T02:38:11.813Z] TASK [will kill node with servers] *********************************************
[2026-04-16T02:38:11.813Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:38:11.813Z] 
[2026-04-16T02:38:11.813Z] TASK [kill node "an-a01n02"] ***************************************************
[2026-04-16T02:38:12.182Z] skipping: [an-a01n01]
[2026-04-16T02:38:12.182Z] changed: [an-a01n02]
[2026-04-16T02:38:12.182Z] 
[2026-04-16T02:38:12.182Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T02:38:12.557Z] skipping: [an-a01n01]
[2026-04-16T02:38:12.557Z] skipping: [an-a01n02]
[2026-04-16T02:38:12.557Z] 
[2026-04-16T02:38:12.557Z] TASK [wait for node to be offline] *********************************************
[2026-04-16T02:38:12.557Z] skipping: [an-a01n02]
[2026-04-16T02:38:12.557Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./offline_node.yml for an-a01n01
[2026-04-16T02:38:12.557Z] 
[2026-04-16T02:38:12.557Z] TASK [wait up to 10 minutes for node an-a01n02 to be offline] ******************
[2026-04-16T02:39:22.686Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (60 retries left).
[2026-04-16T02:39:22.686Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (59 retries left).
[2026-04-16T02:39:22.686Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (58 retries left).
[2026-04-16T02:39:22.686Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (57 retries left).
[2026-04-16T02:39:22.686Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (56 retries left).
[2026-04-16T02:39:22.686Z] ok: [an-a01n01]
[2026-04-16T02:39:22.686Z] 
[2026-04-16T02:39:22.686Z] TASK [check servers status] ****************************************************
[2026-04-16T02:39:22.686Z] skipping: [an-a01n02]
[2026-04-16T02:39:22.686Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01
[2026-04-16T02:39:22.686Z] 
[2026-04-16T02:39:22.686Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:40:21.269Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (120 retries left).
[2026-04-16T02:40:21.269Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (119 retries left).
[2026-04-16T02:40:21.269Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (118 retries left).
[2026-04-16T02:40:21.269Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (117 retries left).
[2026-04-16T02:40:21.269Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (116 retries left).
[2026-04-16T02:40:21.269Z] ok: [an-a01n01]
[2026-04-16T02:40:21.269Z] 
[2026-04-16T02:40:21.269Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:40:21.269Z] ok: [an-a01n01]
[2026-04-16T02:40:21.269Z] 
[2026-04-16T02:40:21.269Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02] => (item=1) 
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02] => (item=2) 
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02] => (item=3) 
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02] => (item=4) 
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02] => (item=5) 
[2026-04-16T02:40:21.638Z] skipping: [an-a01n02]
[2026-04-16T02:40:21.638Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=1)
[2026-04-16T02:40:21.638Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=2)
[2026-04-16T02:40:21.638Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=3)
[2026-04-16T02:40:21.638Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=4)
[2026-04-16T02:40:21.638Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=5)
[2026-04-16T02:40:21.638Z] 
[2026-04-16T02:40:21.638Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:40:38.065Z] FAILED - RETRYING: [an-a01n01]: Wait up to 10 minutes for an-test-deploy1 to respond to ssh (60 retries left).
[2026-04-16T02:40:38.065Z] ok: [an-a01n01]
[2026-04-16T02:40:38.065Z] 
[2026-04-16T02:40:38.065Z] TASK [Wait up to 10 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:40:39.883Z] ok: [an-a01n01]
[2026-04-16T02:40:39.883Z] 
[2026-04-16T02:40:39.883Z] TASK [Wait up to 10 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:40:41.150Z] ok: [an-a01n01]
[2026-04-16T02:40:41.150Z] 
[2026-04-16T02:40:41.150Z] TASK [Wait up to 10 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:40:41.938Z] ok: [an-a01n01]
[2026-04-16T02:40:41.938Z] 
[2026-04-16T02:40:41.938Z] TASK [Wait up to 10 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:40:42.307Z] ok: [an-a01n01]
[2026-04-16T02:40:42.307Z] 
[2026-04-16T02:40:42.307Z] TASK [wait for node to be back online] *****************************************
[2026-04-16T02:40:42.676Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:40:42.676Z] 
[2026-04-16T02:40:42.676Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T02:44:07.611Z] ok: [an-a01n01 -> localhost]
[2026-04-16T02:44:07.611Z] ok: [an-a01n02 -> localhost]
[2026-04-16T02:44:07.611Z] 
[2026-04-16T02:44:07.611Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:44:07.611Z] 
[2026-04-16T02:44:07.611Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:44:07.611Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:44:07.611Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:44:07.611Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:44:07.611Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:44:07.611Z] 
[2026-04-16T02:44:07.611Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:44:07.611Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:44:07.611Z] 
[2026-04-16T02:44:07.611Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T02:44:10.075Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (360 retries left).
[2026-04-16T02:44:10.075Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced (360 retries left).
[2026-04-16T02:44:10.075Z] ok: [an-a01n02]
[2026-04-16T02:44:10.075Z] ok: [an-a01n01]
[2026-04-16T02:44:10.075Z] 
[2026-04-16T02:44:10.075Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T02:44:10.865Z] ok: [an-a01n02]
[2026-04-16T02:44:10.865Z] ok: [an-a01n01]
[2026-04-16T02:44:10.865Z] 
[2026-04-16T02:44:10.865Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T02:44:11.654Z] ok: [an-a01n01]
[2026-04-16T02:44:11.654Z] ok: [an-a01n02]
[2026-04-16T02:44:11.654Z] 
[2026-04-16T02:44:11.654Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T02:44:12.443Z] ok: [an-a01n02]
[2026-04-16T02:44:12.443Z] ok: [an-a01n01]
[2026-04-16T02:44:12.443Z] 
[2026-04-16T02:44:12.443Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (360 retries left).
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (360 retries left).
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (359 retries left).
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (359 retries left).
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n01]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (358 retries left).
[2026-04-16T02:44:46.566Z] FAILED - RETRYING: [an-a01n02]: Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced (358 retries left).
[2026-04-16T02:44:46.566Z] ok: [an-a01n01]
[2026-04-16T02:44:46.566Z] ok: [an-a01n02]
[2026-04-16T02:44:46.566Z] 
[2026-04-16T02:44:46.566Z] TASK [fence with servers iteration 3] ******************************************
[2026-04-16T02:44:46.566Z] ok: [an-a01n01]
[2026-04-16T02:44:46.566Z] ok: [an-a01n02]
[2026-04-16T02:44:46.566Z] 
[2026-04-16T02:44:46.566Z] TASK [check servers status] ****************************************************
[2026-04-16T02:44:46.566Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01, an-a01n02
[2026-04-16T02:44:46.566Z] 
[2026-04-16T02:44:46.566Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:44:47.864Z] ok: [an-a01n01]
[2026-04-16T02:44:47.864Z] ok: [an-a01n02]
[2026-04-16T02:44:47.864Z] 
[2026-04-16T02:44:47.864Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:44:49.682Z] ok: [an-a01n02]
[2026-04-16T02:44:49.682Z] ok: [an-a01n01]
[2026-04-16T02:44:49.682Z] 
[2026-04-16T02:44:49.682Z] TASK [set target] **************************************************************
[2026-04-16T02:44:49.682Z] ok: [an-a01n01]
[2026-04-16T02:44:49.682Z] ok: [an-a01n02]
[2026-04-16T02:44:49.682Z] 
[2026-04-16T02:44:49.682Z] TASK [will kill node with servers] *********************************************
[2026-04-16T02:44:50.050Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:44:50.050Z] 
[2026-04-16T02:44:50.050Z] TASK [kill node "an-a01n01"] ***************************************************
[2026-04-16T02:44:50.837Z] skipping: [an-a01n02]
[2026-04-16T02:44:50.837Z] changed: [an-a01n01]
[2026-04-16T02:44:50.837Z] 
[2026-04-16T02:44:50.837Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T02:44:50.837Z] skipping: [an-a01n01]
[2026-04-16T02:44:50.837Z] skipping: [an-a01n02]
[2026-04-16T02:44:50.837Z] 
[2026-04-16T02:44:50.837Z] TASK [wait for node to be offline] *********************************************
[2026-04-16T02:44:50.837Z] skipping: [an-a01n01]
[2026-04-16T02:44:50.837Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./offline_node.yml for an-a01n02
[2026-04-16T02:44:50.837Z] 
[2026-04-16T02:44:50.837Z] TASK [wait up to 10 minutes for node an-a01n01 to be offline] ******************
[2026-04-16T02:46:00.954Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (60 retries left).
[2026-04-16T02:46:00.954Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (59 retries left).
[2026-04-16T02:46:00.954Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (58 retries left).
[2026-04-16T02:46:00.954Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (57 retries left).
[2026-04-16T02:46:00.954Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (56 retries left).
[2026-04-16T02:46:00.954Z] ok: [an-a01n02]
[2026-04-16T02:46:00.954Z] 
[2026-04-16T02:46:00.954Z] TASK [check servers status] ****************************************************
[2026-04-16T02:46:00.954Z] skipping: [an-a01n01]
[2026-04-16T02:46:00.954Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n02
[2026-04-16T02:46:00.954Z] 
[2026-04-16T02:46:00.954Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:46:59.501Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (120 retries left).
[2026-04-16T02:46:59.501Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (119 retries left).
[2026-04-16T02:46:59.501Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (118 retries left).
[2026-04-16T02:46:59.501Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (117 retries left).
[2026-04-16T02:46:59.501Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (116 retries left).
[2026-04-16T02:46:59.501Z] ok: [an-a01n02]
[2026-04-16T02:46:59.501Z] 
[2026-04-16T02:46:59.501Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:46:59.871Z] ok: [an-a01n02]
[2026-04-16T02:46:59.871Z] 
[2026-04-16T02:46:59.871Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01] => (item=1) 
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01] => (item=2) 
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01] => (item=3) 
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01] => (item=4) 
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01] => (item=5) 
[2026-04-16T02:46:59.871Z] skipping: [an-a01n01]
[2026-04-16T02:46:59.871Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=1)
[2026-04-16T02:46:59.871Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=2)
[2026-04-16T02:46:59.871Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=3)
[2026-04-16T02:46:59.871Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=4)
[2026-04-16T02:46:59.871Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=5)
[2026-04-16T02:46:59.871Z] 
[2026-04-16T02:46:59.871Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:47:16.297Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to respond to ssh (60 retries left).
[2026-04-16T02:47:16.297Z] ok: [an-a01n02]
[2026-04-16T02:47:16.297Z] 
[2026-04-16T02:47:16.297Z] TASK [Wait up to 10 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:47:16.297Z] ok: [an-a01n02]
[2026-04-16T02:47:16.297Z] 
[2026-04-16T02:47:16.297Z] TASK [Wait up to 10 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:47:16.297Z] ok: [an-a01n02]
[2026-04-16T02:47:16.297Z] 
[2026-04-16T02:47:16.297Z] TASK [Wait up to 10 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:47:17.085Z] ok: [an-a01n02]
[2026-04-16T02:47:17.085Z] 
[2026-04-16T02:47:17.085Z] TASK [Wait up to 10 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:47:17.873Z] ok: [an-a01n02]
[2026-04-16T02:47:17.873Z] 
[2026-04-16T02:47:17.873Z] TASK [wait for node to be back online] *****************************************
[2026-04-16T02:47:17.873Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:47:17.873Z] 
[2026-04-16T02:47:17.873Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T02:50:42.825Z] ok: [an-a01n01 -> localhost]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02 -> localhost]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:50:42.825Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:50:42.825Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:50:42.825Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:50:42.825Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n02, an-a01n01 => (item=1)
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n02, an-a01n01 => (item=2)
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n02, an-a01n01 => (item=3)
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n02, an-a01n01 => (item=4)
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n02, an-a01n01 => (item=5)
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [fence with servers iteration 4] ******************************************
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [check servers status] ****************************************************
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01, an-a01n02
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [set target] **************************************************************
[2026-04-16T02:50:42.825Z] ok: [an-a01n01]
[2026-04-16T02:50:42.825Z] ok: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [will kill node with servers] *********************************************
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [kill node "an-a01n02"] ***************************************************
[2026-04-16T02:50:42.825Z] skipping: [an-a01n01]
[2026-04-16T02:50:42.825Z] changed: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T02:50:42.825Z] skipping: [an-a01n01]
[2026-04-16T02:50:42.825Z] skipping: [an-a01n02]
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait for node to be offline] *********************************************
[2026-04-16T02:50:42.825Z] skipping: [an-a01n02]
[2026-04-16T02:50:42.825Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./offline_node.yml for an-a01n01
[2026-04-16T02:50:42.825Z] 
[2026-04-16T02:50:42.825Z] TASK [wait up to 10 minutes for node an-a01n02 to be offline] ******************
[2026-04-16T02:51:53.913Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (60 retries left).
[2026-04-16T02:51:53.913Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (59 retries left).
[2026-04-16T02:51:53.913Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (58 retries left).
[2026-04-16T02:51:53.913Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (57 retries left).
[2026-04-16T02:51:53.913Z] FAILED - RETRYING: [an-a01n01]: wait up to 10 minutes for node an-a01n02 to be offline (56 retries left).
[2026-04-16T02:51:53.913Z] ok: [an-a01n01]
[2026-04-16T02:51:53.913Z] 
[2026-04-16T02:51:53.913Z] TASK [check servers status] ****************************************************
[2026-04-16T02:51:53.913Z] skipping: [an-a01n02]
[2026-04-16T02:51:53.913Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01
[2026-04-16T02:51:53.913Z] 
[2026-04-16T02:51:53.913Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:52:52.461Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (120 retries left).
[2026-04-16T02:52:52.461Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (119 retries left).
[2026-04-16T02:52:52.461Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (118 retries left).
[2026-04-16T02:52:52.461Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (117 retries left).
[2026-04-16T02:52:52.461Z] FAILED - RETRYING: [an-a01n01]: wait up to 20 minutes for servers to be Started (116 retries left).
[2026-04-16T02:52:52.461Z] ok: [an-a01n01]
[2026-04-16T02:52:52.461Z] 
[2026-04-16T02:52:52.461Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:52:52.461Z] ok: [an-a01n01]
[2026-04-16T02:52:52.461Z] 
[2026-04-16T02:52:52.461Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02] => (item=1) 
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02] => (item=2) 
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02] => (item=3) 
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02] => (item=4) 
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02] => (item=5) 
[2026-04-16T02:52:52.461Z] skipping: [an-a01n02]
[2026-04-16T02:52:52.461Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=1)
[2026-04-16T02:52:52.461Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=2)
[2026-04-16T02:52:52.461Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=3)
[2026-04-16T02:52:52.461Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=4)
[2026-04-16T02:52:52.461Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n01 => (item=5)
[2026-04-16T02:52:52.461Z] 
[2026-04-16T02:52:52.461Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:53:03.760Z] FAILED - RETRYING: [an-a01n01]: Wait up to 10 minutes for an-test-deploy1 to respond to ssh (60 retries left).
[2026-04-16T02:53:03.760Z] ok: [an-a01n01]
[2026-04-16T02:53:03.760Z] 
[2026-04-16T02:53:03.760Z] TASK [Wait up to 10 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:53:04.547Z] ok: [an-a01n01]
[2026-04-16T02:53:04.547Z] 
[2026-04-16T02:53:04.547Z] TASK [Wait up to 10 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:53:05.334Z] ok: [an-a01n01]
[2026-04-16T02:53:05.334Z] 
[2026-04-16T02:53:05.334Z] TASK [Wait up to 10 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:53:06.121Z] ok: [an-a01n01]
[2026-04-16T02:53:06.121Z] 
[2026-04-16T02:53:06.121Z] TASK [Wait up to 10 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:53:06.908Z] ok: [an-a01n01]
[2026-04-16T02:53:06.908Z] 
[2026-04-16T02:53:06.908Z] TASK [wait for node to be back online] *****************************************
[2026-04-16T02:53:06.908Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:53:06.908Z] 
[2026-04-16T02:53:06.908Z] TASK [wait for node "an-a01n02" to be back online] *****************************
[2026-04-16T02:56:31.866Z] ok: [an-a01n01 -> localhost]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02 -> localhost]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T02:56:31.866Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T02:56:31.866Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T02:56:31.866Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T02:56:31.866Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [fence with servers iteration 5] ******************************************
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [check servers status] ****************************************************
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n01, an-a01n02
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [set target] **************************************************************
[2026-04-16T02:56:31.866Z] ok: [an-a01n01]
[2026-04-16T02:56:31.866Z] ok: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [will kill node with servers] *********************************************
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./kill_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [kill node "an-a01n01"] ***************************************************
[2026-04-16T02:56:31.866Z] skipping: [an-a01n02]
[2026-04-16T02:56:31.866Z] changed: [an-a01n01]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T02:56:31.866Z] skipping: [an-a01n01]
[2026-04-16T02:56:31.866Z] skipping: [an-a01n02]
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait for node to be offline] *********************************************
[2026-04-16T02:56:31.866Z] skipping: [an-a01n01]
[2026-04-16T02:56:31.866Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./offline_node.yml for an-a01n02
[2026-04-16T02:56:31.866Z] 
[2026-04-16T02:56:31.866Z] TASK [wait up to 10 minutes for node an-a01n01 to be offline] ******************
[2026-04-16T02:57:42.008Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (60 retries left).
[2026-04-16T02:57:42.008Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (59 retries left).
[2026-04-16T02:57:42.008Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (58 retries left).
[2026-04-16T02:57:42.008Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (57 retries left).
[2026-04-16T02:57:42.008Z] FAILED - RETRYING: [an-a01n02]: wait up to 10 minutes for node an-a01n01 to be offline (56 retries left).
[2026-04-16T02:57:42.008Z] ok: [an-a01n02]
[2026-04-16T02:57:42.008Z] 
[2026-04-16T02:57:42.008Z] TASK [check servers status] ****************************************************
[2026-04-16T02:57:42.008Z] skipping: [an-a01n01]
[2026-04-16T02:57:42.008Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./server_started.yml for an-a01n02
[2026-04-16T02:57:42.008Z] 
[2026-04-16T02:57:42.008Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T02:58:40.671Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (120 retries left).
[2026-04-16T02:58:40.671Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (119 retries left).
[2026-04-16T02:58:40.671Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (118 retries left).
[2026-04-16T02:58:40.671Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (117 retries left).
[2026-04-16T02:58:40.671Z] FAILED - RETRYING: [an-a01n02]: wait up to 20 minutes for servers to be Started (116 retries left).
[2026-04-16T02:58:40.671Z] ok: [an-a01n02]
[2026-04-16T02:58:40.671Z] 
[2026-04-16T02:58:40.671Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T02:58:40.671Z] ok: [an-a01n02]
[2026-04-16T02:58:40.671Z] 
[2026-04-16T02:58:40.671Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01] => (item=1) 
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01] => (item=2) 
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01] => (item=3) 
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01] => (item=4) 
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01] => (item=5) 
[2026-04-16T02:58:40.671Z] skipping: [an-a01n01]
[2026-04-16T02:58:40.671Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=1)
[2026-04-16T02:58:40.671Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=2)
[2026-04-16T02:58:40.671Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=3)
[2026-04-16T02:58:40.671Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=4)
[2026-04-16T02:58:40.671Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_ssh.yml for an-a01n02 => (item=5)
[2026-04-16T02:58:40.671Z] 
[2026-04-16T02:58:40.671Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T02:58:54.430Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to respond to ssh (60 retries left).
[2026-04-16T02:58:54.430Z] ok: [an-a01n02]
[2026-04-16T02:58:54.430Z] 
[2026-04-16T02:58:54.430Z] TASK [Wait up to 10 minutes for an-test-deploy2 to respond to ssh] *************
[2026-04-16T02:58:54.804Z] ok: [an-a01n02]
[2026-04-16T02:58:54.804Z] 
[2026-04-16T02:58:54.804Z] TASK [Wait up to 10 minutes for an-test-deploy3 to respond to ssh] *************
[2026-04-16T02:58:55.610Z] ok: [an-a01n02]
[2026-04-16T02:58:55.610Z] 
[2026-04-16T02:58:55.610Z] TASK [Wait up to 10 minutes for an-test-deploy4 to respond to ssh] *************
[2026-04-16T02:58:56.408Z] ok: [an-a01n02]
[2026-04-16T02:58:56.408Z] 
[2026-04-16T02:58:56.408Z] TASK [Wait up to 10 minutes for an-test-deploy5 to respond to ssh] *************
[2026-04-16T02:58:56.776Z] ok: [an-a01n02]
[2026-04-16T02:58:56.776Z] 
[2026-04-16T02:58:56.776Z] TASK [wait for node to be back online] *****************************************
[2026-04-16T02:58:57.146Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_node.yml for an-a01n01, an-a01n02
[2026-04-16T02:58:57.146Z] 
[2026-04-16T02:58:57.146Z] TASK [wait for node "an-a01n01" to be back online] *****************************
[2026-04-16T03:02:07.370Z] ok: [an-a01n01 -> localhost]
[2026-04-16T03:02:07.370Z] ok: [an-a01n02 -> localhost]
[2026-04-16T03:02:07.370Z] 
[2026-04-16T03:02:07.370Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T03:02:07.370Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:07.370Z] 
[2026-04-16T03:02:07.370Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T03:02:12.448Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T03:02:12.448Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T03:02:12.448Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T03:02:12.448Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T03:02:12.448Z] 
[2026-04-16T03:02:12.448Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T03:02:12.448Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T03:02:12.448Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T03:02:12.448Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T03:02:12.448Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T03:02:12.448Z] included: /srv/anvil/anvil-test-suite/playbooks/tests/functional-tests/../../common/./wait_server_drbd_sync.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T03:02:12.448Z] 
[2026-04-16T03:02:12.448Z] TASK [Wait up to 60 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:02:12.817Z] ok: [an-a01n01]
[2026-04-16T03:02:12.817Z] ok: [an-a01n02]
[2026-04-16T03:02:12.817Z] 
[2026-04-16T03:02:12.817Z] TASK [Wait up to 60 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T03:02:13.606Z] ok: [an-a01n01]
[2026-04-16T03:02:13.606Z] ok: [an-a01n02]
[2026-04-16T03:02:13.606Z] 
[2026-04-16T03:02:13.606Z] TASK [Wait up to 60 minutes for an-test-deploy3 drbd storage to be synced] *****
[2026-04-16T03:02:14.394Z] ok: [an-a01n01]
[2026-04-16T03:02:14.394Z] ok: [an-a01n02]
[2026-04-16T03:02:14.394Z] 
[2026-04-16T03:02:14.394Z] TASK [Wait up to 60 minutes for an-test-deploy4 drbd storage to be synced] *****
[2026-04-16T03:02:14.767Z] ok: [an-a01n01]
[2026-04-16T03:02:14.767Z] ok: [an-a01n02]
[2026-04-16T03:02:14.767Z] 
[2026-04-16T03:02:14.767Z] TASK [Wait up to 60 minutes for an-test-deploy5 drbd storage to be synced] *****
[2026-04-16T03:02:15.565Z] ok: [an-a01n01]
[2026-04-16T03:02:15.565Z] ok: [an-a01n02]
[2026-04-16T03:02:15.565Z] 
[2026-04-16T03:02:15.565Z] PLAY [basic server tests] ******************************************************
[2026-04-16T03:02:15.565Z] 
[2026-04-16T03:02:15.565Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:02:18.028Z] ok: [an-a01n01]
[2026-04-16T03:02:18.028Z] ok: [an-a01n02]
[2026-04-16T03:02:18.028Z] 
[2026-04-16T03:02:18.028Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T03:02:18.028Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:18.028Z] 
[2026-04-16T03:02:18.028Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T03:02:22.184Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T03:02:22.184Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T03:02:22.184Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T03:02:22.184Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T03:02:22.184Z] 
[2026-04-16T03:02:22.184Z] TASK [check anvil-provision-server storage group] ******************************
[2026-04-16T03:02:22.184Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_storage_group.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:22.184Z] 
[2026-04-16T03:02:22.184Z] TASK [get anvil-provision-server storage group] ********************************
[2026-04-16T03:02:28.503Z] changed: [an-a01n01]
[2026-04-16T03:02:28.503Z] changed: [an-a01n02]
[2026-04-16T03:02:28.503Z] 
[2026-04-16T03:02:28.503Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:02:28.503Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_install_iso.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:28.503Z] 
[2026-04-16T03:02:28.503Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:02:33.650Z] changed: [an-a01n01]
[2026-04-16T03:02:33.650Z] changed: [an-a01n02]
[2026-04-16T03:02:33.650Z] 
[2026-04-16T03:02:33.650Z] TASK [deploy server 1 from "an-a01n01"] ****************************************
[2026-04-16T03:02:33.650Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:33.650Z] 
[2026-04-16T03:02:33.650Z] TASK [check if server an-test-deploy1 exists] **********************************
[2026-04-16T03:02:35.021Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.021Z] ok: [an-a01n01]
[2026-04-16T03:02:35.021Z] 
[2026-04-16T03:02:35.021Z] TASK [deploy server an-test-deploy1 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T03:02:35.432Z] skipping: [an-a01n01]
[2026-04-16T03:02:35.432Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.432Z] 
[2026-04-16T03:02:35.432Z] TASK [Wait up to 10 minutes for an-test-deploy1 to be started in pacemaker] ****
[2026-04-16T03:02:35.432Z] skipping: [an-a01n01]
[2026-04-16T03:02:35.432Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.432Z] 
[2026-04-16T03:02:35.432Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:02:35.432Z] skipping: [an-a01n01]
[2026-04-16T03:02:35.432Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.432Z] 
[2026-04-16T03:02:35.432Z] TASK [Wait up to 10 minutes for an-test-deploy1 to start installation] *********
[2026-04-16T03:02:35.432Z] skipping: [an-a01n01]
[2026-04-16T03:02:35.432Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.432Z] 
[2026-04-16T03:02:35.432Z] TASK [Wait up to 10 minutes for an-test-deploy1 to complete installation] ******
[2026-04-16T03:02:35.432Z] skipping: [an-a01n01]
[2026-04-16T03:02:35.432Z] skipping: [an-a01n02]
[2026-04-16T03:02:35.432Z] 
[2026-04-16T03:02:35.432Z] TASK [deploy server 2 from "an-a01n02"] ****************************************
[2026-04-16T03:02:35.802Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:35.802Z] 
[2026-04-16T03:02:35.802Z] TASK [check if server an-test-deploy2 exists] **********************************
[2026-04-16T03:02:37.116Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.116Z] ok: [an-a01n02]
[2026-04-16T03:02:37.116Z] 
[2026-04-16T03:02:37.116Z] TASK [deploy server an-test-deploy2 from an-a01n02 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T03:02:37.489Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.489Z] skipping: [an-a01n02]
[2026-04-16T03:02:37.489Z] 
[2026-04-16T03:02:37.489Z] TASK [Wait up to 10 minutes for an-test-deploy2 to be started in pacemaker] ****
[2026-04-16T03:02:37.489Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.489Z] skipping: [an-a01n02]
[2026-04-16T03:02:37.489Z] 
[2026-04-16T03:02:37.489Z] TASK [Wait up to 10 minutes for an-test-deploy2 drbd storage to be synced] *****
[2026-04-16T03:02:37.489Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.489Z] skipping: [an-a01n02]
[2026-04-16T03:02:37.489Z] 
[2026-04-16T03:02:37.489Z] TASK [Wait up to 10 minutes for an-test-deploy2 to start installation] *********
[2026-04-16T03:02:37.489Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.489Z] skipping: [an-a01n02]
[2026-04-16T03:02:37.489Z] 
[2026-04-16T03:02:37.489Z] TASK [Wait up to 10 minutes for an-test-deploy2 to complete installation] ******
[2026-04-16T03:02:37.489Z] skipping: [an-a01n01]
[2026-04-16T03:02:37.489Z] skipping: [an-a01n02]
[2026-04-16T03:02:37.489Z] 
[2026-04-16T03:02:37.489Z] TASK [check servers status] ****************************************************
[2026-04-16T03:02:37.929Z] included: /srv/anvil/anvil-test-suite/playbooks/common/server_started.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:37.929Z] 
[2026-04-16T03:02:37.929Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T03:02:39.828Z] ok: [an-a01n01]
[2026-04-16T03:02:39.828Z] ok: [an-a01n02]
[2026-04-16T03:02:39.828Z] 
[2026-04-16T03:02:39.828Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T03:02:41.660Z] ok: [an-a01n01]
[2026-04-16T03:02:41.660Z] ok: [an-a01n02]
[2026-04-16T03:02:41.660Z] 
[2026-04-16T03:02:41.660Z] PLAY [delete extra server tests] ***********************************************
[2026-04-16T03:02:41.660Z] 
[2026-04-16T03:02:41.660Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:02:44.161Z] ok: [an-a01n01]
[2026-04-16T03:02:44.161Z] ok: [an-a01n02]
[2026-04-16T03:02:44.161Z] 
[2026-04-16T03:02:44.161Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T03:02:44.161Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T03:02:44.161Z] 
[2026-04-16T03:02:44.161Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T03:02:48.718Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T03:02:48.718Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T03:02:48.718Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T03:02:48.718Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T03:02:48.718Z] 
[2026-04-16T03:02:48.718Z] TASK [delete servers] **********************************************************
[2026-04-16T03:02:48.718Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T03:02:48.718Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T03:02:48.718Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T03:02:48.718Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T03:02:48.718Z] 
[2026-04-16T03:02:48.718Z] TASK [check if server an-test-deploy2 exists] **********************************
[2026-04-16T03:02:49.941Z] skipping: [an-a01n01]
[2026-04-16T03:02:49.941Z] ok: [an-a01n02]
[2026-04-16T03:02:49.941Z] 
[2026-04-16T03:02:49.941Z] TASK [delete server an-test-deploy2 from an-a01n02] ****************************
[2026-04-16T03:02:57.670Z] skipping: [an-a01n01]
[2026-04-16T03:02:57.670Z] changed: [an-a01n02]
[2026-04-16T03:02:57.670Z] 
[2026-04-16T03:02:57.670Z] TASK [Wait up to 10 minutes for an-test-deploy2 to be delete in pacemaker] *****
[2026-04-16T03:03:26.443Z] skipping: [an-a01n01]
[2026-04-16T03:03:26.443Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy2 to be delete in pacemaker (60 retries left).
[2026-04-16T03:03:26.443Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy2 to be delete in pacemaker (59 retries left).
[2026-04-16T03:03:26.443Z] ok: [an-a01n02]
[2026-04-16T03:03:26.443Z] 
[2026-04-16T03:03:26.443Z] TASK [Wait up to 10 minutes for an-test-deploy2 drbd storage to be removed] ****
[2026-04-16T03:03:26.443Z] skipping: [an-a01n01]
[2026-04-16T03:03:26.443Z] ok: [an-a01n02]
[2026-04-16T03:03:26.443Z] 
[2026-04-16T03:03:26.443Z] TASK [Wait up to 10 minutes for an-test-deploy2 lvm volume to be removed] ******
[2026-04-16T03:03:26.443Z] skipping: [an-a01n01]
[2026-04-16T03:03:26.443Z] ok: [an-a01n02]
[2026-04-16T03:03:26.443Z] 
[2026-04-16T03:03:26.443Z] TASK [check if server an-test-deploy3 exists] **********************************
[2026-04-16T03:03:26.443Z] skipping: [an-a01n01]
[2026-04-16T03:03:26.443Z] ok: [an-a01n02]
[2026-04-16T03:03:26.443Z] 
[2026-04-16T03:03:26.443Z] TASK [delete server an-test-deploy3 from an-a01n02] ****************************
[2026-04-16T03:03:34.170Z] skipping: [an-a01n01]
[2026-04-16T03:03:34.170Z] changed: [an-a01n02]
[2026-04-16T03:03:34.170Z] 
[2026-04-16T03:03:34.170Z] TASK [Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker] *****
[2026-04-16T03:04:44.504Z] skipping: [an-a01n01]
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (60 retries left).
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (59 retries left).
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (58 retries left).
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (57 retries left).
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (56 retries left).
[2026-04-16T03:04:44.504Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker (55 retries left).
[2026-04-16T03:04:44.504Z] ok: [an-a01n02]
[2026-04-16T03:04:44.504Z] 
[2026-04-16T03:04:44.504Z] TASK [Wait up to 10 minutes for an-test-deploy3 drbd storage to be removed] ****
[2026-04-16T03:04:45.334Z] skipping: [an-a01n01]
[2026-04-16T03:04:45.334Z] ok: [an-a01n02]
[2026-04-16T03:04:45.334Z] 
[2026-04-16T03:04:45.334Z] TASK [Wait up to 10 minutes for an-test-deploy3 lvm volume to be removed] ******
[2026-04-16T03:04:46.220Z] skipping: [an-a01n01]
[2026-04-16T03:04:46.220Z] ok: [an-a01n02]
[2026-04-16T03:04:46.220Z] 
[2026-04-16T03:04:46.220Z] TASK [check if server an-test-deploy4 exists] **********************************
[2026-04-16T03:04:47.528Z] skipping: [an-a01n01]
[2026-04-16T03:04:47.528Z] ok: [an-a01n02]
[2026-04-16T03:04:47.528Z] 
[2026-04-16T03:04:47.528Z] TASK [delete server an-test-deploy4 from an-a01n02] ****************************
[2026-04-16T03:04:56.872Z] skipping: [an-a01n01]
[2026-04-16T03:04:56.872Z] changed: [an-a01n02]
[2026-04-16T03:04:56.872Z] 
[2026-04-16T03:04:56.872Z] TASK [Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker] *****
[2026-04-16T03:07:51.857Z] skipping: [an-a01n01]
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (60 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (59 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (58 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (57 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (56 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (55 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (54 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (53 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (52 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (51 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (50 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (49 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (48 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (47 retries left).
[2026-04-16T03:07:51.857Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker (46 retries left).
[2026-04-16T03:07:51.857Z] ok: [an-a01n02]
[2026-04-16T03:07:51.857Z] 
[2026-04-16T03:07:51.857Z] TASK [Wait up to 10 minutes for an-test-deploy4 drbd storage to be removed] ****
[2026-04-16T03:07:52.255Z] skipping: [an-a01n01]
[2026-04-16T03:07:52.255Z] ok: [an-a01n02]
[2026-04-16T03:07:52.255Z] 
[2026-04-16T03:07:52.255Z] TASK [Wait up to 10 minutes for an-test-deploy4 lvm volume to be removed] ******
[2026-04-16T03:07:53.043Z] skipping: [an-a01n01]
[2026-04-16T03:07:53.043Z] ok: [an-a01n02]
[2026-04-16T03:07:53.043Z] 
[2026-04-16T03:07:53.043Z] TASK [check if server an-test-deploy5 exists] **********************************
[2026-04-16T03:07:54.863Z] skipping: [an-a01n01]
[2026-04-16T03:07:54.863Z] ok: [an-a01n02]
[2026-04-16T03:07:54.863Z] 
[2026-04-16T03:07:54.863Z] TASK [delete server an-test-deploy5 from an-a01n02] ****************************
[2026-04-16T03:08:02.532Z] skipping: [an-a01n01]
[2026-04-16T03:08:02.532Z] changed: [an-a01n02]
[2026-04-16T03:08:02.532Z] 
[2026-04-16T03:08:02.532Z] TASK [Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker] *****
[2026-04-16T03:09:12.649Z] skipping: [an-a01n01]
[2026-04-16T03:09:12.649Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker (60 retries left).
[2026-04-16T03:09:12.649Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker (59 retries left).
[2026-04-16T03:09:12.649Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker (58 retries left).
[2026-04-16T03:09:12.649Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker (57 retries left).
[2026-04-16T03:09:12.649Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker (56 retries left).
[2026-04-16T03:09:12.649Z] ok: [an-a01n02]
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [Wait up to 10 minutes for an-test-deploy5 drbd storage to be removed] ****
[2026-04-16T03:09:12.649Z] skipping: [an-a01n01]
[2026-04-16T03:09:12.649Z] ok: [an-a01n02]
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [Wait up to 10 minutes for an-test-deploy5 lvm volume to be removed] ******
[2026-04-16T03:09:12.649Z] skipping: [an-a01n01]
[2026-04-16T03:09:12.649Z] ok: [an-a01n02]
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] PLAY [create server for DR testing] ********************************************
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:09:12.649Z] ok: [an-a01n02]
[2026-04-16T03:09:12.649Z] ok: [an-a01n01]
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T03:09:12.649Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T03:09:12.649Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T03:09:12.649Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T03:09:12.649Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T03:09:12.649Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [check anvil-provision-server storage group] ******************************
[2026-04-16T03:09:12.649Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_storage_group.yml for an-a01n01, an-a01n02
[2026-04-16T03:09:12.649Z] 
[2026-04-16T03:09:12.649Z] TASK [get anvil-provision-server storage group] ********************************
[2026-04-16T03:09:15.104Z] changed: [an-a01n01]
[2026-04-16T03:09:15.104Z] changed: [an-a01n02]
[2026-04-16T03:09:15.104Z] 
[2026-04-16T03:09:15.104Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:09:15.473Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_install_iso.yml for an-a01n01, an-a01n02
[2026-04-16T03:09:15.473Z] 
[2026-04-16T03:09:15.473Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:09:20.545Z] changed: [an-a01n01]
[2026-04-16T03:09:20.545Z] changed: [an-a01n02]
[2026-04-16T03:09:20.545Z] 
[2026-04-16T03:09:20.545Z] TASK [deploy server 1 from "an-a01n01"] ****************************************
[2026-04-16T03:09:20.545Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02
[2026-04-16T03:09:20.545Z] 
[2026-04-16T03:09:20.545Z] TASK [check if server an-test-deploy1 exists] **********************************
[2026-04-16T03:09:22.364Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.364Z] ok: [an-a01n01]
[2026-04-16T03:09:22.364Z] 
[2026-04-16T03:09:22.364Z] TASK [deploy server an-test-deploy1 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T03:09:22.364Z] skipping: [an-a01n01]
[2026-04-16T03:09:22.364Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.364Z] 
[2026-04-16T03:09:22.364Z] TASK [Wait up to 10 minutes for an-test-deploy1 to be started in pacemaker] ****
[2026-04-16T03:09:22.364Z] skipping: [an-a01n01]
[2026-04-16T03:09:22.364Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.364Z] 
[2026-04-16T03:09:22.364Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:09:22.364Z] skipping: [an-a01n01]
[2026-04-16T03:09:22.364Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.364Z] 
[2026-04-16T03:09:22.364Z] TASK [Wait up to 10 minutes for an-test-deploy1 to start installation] *********
[2026-04-16T03:09:22.733Z] skipping: [an-a01n01]
[2026-04-16T03:09:22.733Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.733Z] 
[2026-04-16T03:09:22.733Z] TASK [Wait up to 10 minutes for an-test-deploy1 to complete installation] ******
[2026-04-16T03:09:22.733Z] skipping: [an-a01n01]
[2026-04-16T03:09:22.733Z] skipping: [an-a01n02]
[2026-04-16T03:09:22.733Z] 
[2026-04-16T03:09:22.733Z] TASK [check servers status] ****************************************************
[2026-04-16T03:09:22.733Z] included: /srv/anvil/anvil-test-suite/playbooks/common/server_started.yml for an-a01n01, an-a01n02
[2026-04-16T03:09:22.733Z] 
[2026-04-16T03:09:22.733Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T03:09:24.554Z] ok: [an-a01n02]
[2026-04-16T03:09:24.554Z] ok: [an-a01n01]
[2026-04-16T03:09:24.554Z] 
[2026-04-16T03:09:24.554Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T03:09:27.011Z] ok: [an-a01n02]
[2026-04-16T03:09:27.011Z] ok: [an-a01n01]
[2026-04-16T03:09:27.011Z] 
[2026-04-16T03:09:27.011Z] PLAY [DR tests] ****************************************************************
[2026-04-16T03:09:27.011Z] 
[2026-04-16T03:09:27.011Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:09:28.831Z] ok: [an-a01dr01]
[2026-04-16T03:09:28.831Z] 
[2026-04-16T03:09:28.831Z] TASK [check DR is correctly deployed] ******************************************
[2026-04-16T03:09:32.889Z] changed: [an-a01dr01]
[2026-04-16T03:09:32.889Z] 
[2026-04-16T03:09:32.889Z] TASK [check DR host is registered in the DB] ***********************************
[2026-04-16T03:09:37.961Z] changed: [an-a01dr01]
[2026-04-16T03:09:37.961Z] 
[2026-04-16T03:09:37.961Z] TASK [check no DR hosts are linked] ********************************************
[2026-04-16T03:09:42.023Z] changed: [an-a01dr01]
[2026-04-16T03:09:42.023Z] 
[2026-04-16T03:09:42.023Z] TASK [link DR host to anvil] ***************************************************
[2026-04-16T03:09:47.096Z] changed: [an-a01dr01]
[2026-04-16T03:09:47.096Z] 
[2026-04-16T03:09:47.096Z] TASK [verify DR host is linked to anvil] ***************************************
[2026-04-16T03:09:52.173Z] changed: [an-a01dr01]
[2026-04-16T03:09:52.173Z] 
[2026-04-16T03:09:52.173Z] TASK [link DR vg to storage group] *********************************************
[2026-04-16T03:09:59.843Z] changed: [an-a01dr01]
[2026-04-16T03:09:59.843Z] 
[2026-04-16T03:09:59.843Z] TASK [verify DR vg is linked to storage group] *********************************
[2026-04-16T03:10:03.039Z] changed: [an-a01dr01]
[2026-04-16T03:10:03.039Z] 
[2026-04-16T03:10:03.039Z] TASK [protect an-test-deploy1 short-throw] *************************************
[2026-04-16T03:10:08.113Z] changed: [an-a01dr01]
[2026-04-16T03:10:08.113Z] 
[2026-04-16T03:10:08.113Z] TASK [verify an-test-deploy1 DR drbd status short-throw] ***********************
[2026-04-16T03:10:08.113Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_dr_sync.yml for an-a01dr01
[2026-04-16T03:10:08.113Z] 
[2026-04-16T03:10:08.113Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created] ***
[2026-04-16T03:10:52.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (120 retries left).
[2026-04-16T03:10:52.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (119 retries left).
[2026-04-16T03:10:52.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (118 retries left).
[2026-04-16T03:10:52.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (117 retries left).
[2026-04-16T03:10:52.091Z] ok: [an-a01dr01]
[2026-04-16T03:10:52.091Z] 
[2026-04-16T03:10:52.091Z] TASK [Check correct drbd protocol is configured] *******************************
[2026-04-16T03:10:52.091Z] changed: [an-a01dr01]
[2026-04-16T03:10:52.091Z] 
[2026-04-16T03:10:52.091Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (120 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (119 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (118 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (117 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (116 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (115 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (114 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (113 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (112 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (111 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (110 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (109 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (108 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (107 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (106 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (105 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (104 retries left).
[2026-04-16T03:14:17.013Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (103 retries left).
[2026-04-16T03:14:17.013Z] ok: [an-a01dr01]
[2026-04-16T03:14:17.013Z] 
[2026-04-16T03:14:17.013Z] TASK [verify disconnect/update/connect features short-throw] *******************
[2026-04-16T03:14:17.013Z] included: /srv/anvil/anvil-test-suite/playbooks/common/check_server_drbd_dr_management.yml for an-a01dr01
[2026-04-16T03:14:17.013Z] 
[2026-04-16T03:14:17.013Z] TASK [Verify an-test-deploy1 drbd storage is synced] ***************************
[2026-04-16T03:14:17.013Z] ok: [an-a01dr01]
[2026-04-16T03:14:17.013Z] 
[2026-04-16T03:14:17.013Z] TASK [Disconnect an-test-deploy1 drbd storage] *********************************
[2026-04-16T03:14:17.013Z] changed: [an-a01dr01]
[2026-04-16T03:14:17.013Z] 
[2026-04-16T03:14:17.013Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected] ***
[2026-04-16T03:14:33.440Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (120 retries left).
[2026-04-16T03:14:33.440Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (119 retries left).
[2026-04-16T03:14:33.440Z] ok: [an-a01dr01]
[2026-04-16T03:14:33.440Z] 
[2026-04-16T03:14:33.440Z] TASK [Inject random data to an-test-deploy1] ***********************************
[2026-04-16T03:16:42.806Z] changed: [an-a01dr01 -> localhost]
[2026-04-16T03:16:42.806Z] 
[2026-04-16T03:16:42.806Z] TASK [Update an-test-deploy1 drbd storage] *************************************
[2026-04-16T03:16:44.624Z] changed: [an-a01dr01]
[2026-04-16T03:16:44.624Z] 
[2026-04-16T03:16:44.624Z] TASK [Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected] ***
[2026-04-16T03:17:08.320Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (120 retries left).
[2026-04-16T03:17:08.320Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (119 retries left).
[2026-04-16T03:17:08.320Z] ok: [an-a01dr01]
[2026-04-16T03:17:08.320Z] 
[2026-04-16T03:17:08.320Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected] ***
[2026-04-16T03:17:17.649Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (120 retries left).
[2026-04-16T03:17:17.649Z] ok: [an-a01dr01]
[2026-04-16T03:17:17.649Z] 
[2026-04-16T03:17:17.649Z] TASK [Reconnect an-test-deploy1 drbd storage] **********************************
[2026-04-16T03:17:23.910Z] changed: [an-a01dr01]
[2026-04-16T03:17:23.910Z] 
[2026-04-16T03:17:23.910Z] TASK [Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected] ***
[2026-04-16T03:17:47.607Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (120 retries left).
[2026-04-16T03:17:47.607Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (119 retries left).
[2026-04-16T03:17:47.607Z] ok: [an-a01dr01]
[2026-04-16T03:17:47.607Z] 
[2026-04-16T03:17:47.607Z] TASK [remove an-test-deploy1 protection short-throw] ***************************
[2026-04-16T03:17:51.668Z] changed: [an-a01dr01]
[2026-04-16T03:17:51.668Z] 
[2026-04-16T03:17:51.668Z] TASK [verify an-test-deploy1 DR drbd clean status short-throw] *****************
[2026-04-16T03:17:51.668Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_dr_clean.yml for an-a01dr01
[2026-04-16T03:17:51.668Z] 
[2026-04-16T03:17:51.668Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed] ****
[2026-04-16T03:18:40.557Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (60 retries left).
[2026-04-16T03:18:40.557Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (59 retries left).
[2026-04-16T03:18:40.557Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (58 retries left).
[2026-04-16T03:18:40.557Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (57 retries left).
[2026-04-16T03:18:40.557Z] ok: [an-a01dr01]
[2026-04-16T03:18:40.557Z] 
[2026-04-16T03:18:40.557Z] TASK [Wait up to 10 minutes for an-test-deploy1 lvm volume to be removed] ******
[2026-04-16T03:18:45.629Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 lvm volume to be removed (60 retries left).
[2026-04-16T03:18:45.629Z] ok: [an-a01dr01]
[2026-04-16T03:18:45.629Z] 
[2026-04-16T03:18:45.629Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed] ***
[2026-04-16T03:19:19.734Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (60 retries left).
[2026-04-16T03:19:19.734Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (59 retries left).
[2026-04-16T03:19:19.734Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (58 retries left).
[2026-04-16T03:19:19.734Z] ok: [an-a01dr01]
[2026-04-16T03:19:19.734Z] 
[2026-04-16T03:19:19.734Z] TASK [check drbd sync status on nodes after disconnect short-throw] ************
[2026-04-16T03:19:19.734Z] changed: [an-a01dr01 -> an-a01n01]
[2026-04-16T03:19:19.734Z] 
[2026-04-16T03:19:19.734Z] TASK [protect an-test-deploy1 sync] ********************************************
[2026-04-16T03:19:24.809Z] changed: [an-a01dr01]
[2026-04-16T03:19:24.809Z] 
[2026-04-16T03:19:24.809Z] TASK [verify an-test-deploy1 DR drbd status sync] ******************************
[2026-04-16T03:19:24.809Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_dr_sync.yml for an-a01dr01
[2026-04-16T03:19:24.809Z] 
[2026-04-16T03:19:24.809Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created] ***
[2026-04-16T03:19:58.875Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (120 retries left).
[2026-04-16T03:19:58.875Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (119 retries left).
[2026-04-16T03:19:58.875Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage resource to be created (118 retries left).
[2026-04-16T03:19:58.875Z] ok: [an-a01dr01]
[2026-04-16T03:19:58.875Z] 
[2026-04-16T03:19:58.875Z] TASK [Check correct drbd protocol is configured] *******************************
[2026-04-16T03:19:58.875Z] changed: [an-a01dr01]
[2026-04-16T03:19:58.875Z] 
[2026-04-16T03:19:58.875Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:22:38.474Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (120 retries left).
[2026-04-16T03:22:38.474Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (119 retries left).
[2026-04-16T03:22:38.474Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (118 retries left).
[2026-04-16T03:22:38.474Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (117 retries left).
[2026-04-16T03:22:38.474Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (116 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (115 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (114 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (113 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (112 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (111 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (110 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (109 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (108 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (107 retries left).
[2026-04-16T03:22:38.475Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be synced (106 retries left).
[2026-04-16T03:22:38.475Z] ok: [an-a01dr01]
[2026-04-16T03:22:38.475Z] 
[2026-04-16T03:22:38.475Z] TASK [verify disconnect/update/connect features sync] **************************
[2026-04-16T03:22:38.475Z] included: /srv/anvil/anvil-test-suite/playbooks/common/check_server_drbd_dr_management.yml for an-a01dr01
[2026-04-16T03:22:38.475Z] 
[2026-04-16T03:22:38.475Z] TASK [Verify an-test-deploy1 drbd storage is synced] ***************************
[2026-04-16T03:22:38.475Z] ok: [an-a01dr01]
[2026-04-16T03:22:38.475Z] 
[2026-04-16T03:22:38.475Z] TASK [Disconnect an-test-deploy1 drbd storage] *********************************
[2026-04-16T03:22:43.563Z] changed: [an-a01dr01]
[2026-04-16T03:22:43.563Z] 
[2026-04-16T03:22:43.563Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected] ***
[2026-04-16T03:23:07.260Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (120 retries left).
[2026-04-16T03:23:07.260Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (119 retries left).
[2026-04-16T03:23:07.260Z] ok: [an-a01dr01]
[2026-04-16T03:23:07.260Z] 
[2026-04-16T03:23:07.260Z] TASK [Inject random data to an-test-deploy1] ***********************************
[2026-04-16T03:25:31.740Z] changed: [an-a01dr01 -> localhost]
[2026-04-16T03:25:31.740Z] 
[2026-04-16T03:25:31.740Z] TASK [Update an-test-deploy1 drbd storage] *************************************
[2026-04-16T03:25:31.740Z] changed: [an-a01dr01]
[2026-04-16T03:25:31.740Z] 
[2026-04-16T03:25:31.740Z] TASK [Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected] ***
[2026-04-16T03:25:45.387Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (120 retries left).
[2026-04-16T03:25:45.387Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (119 retries left).
[2026-04-16T03:25:45.387Z] ok: [an-a01dr01]
[2026-04-16T03:25:45.387Z] 
[2026-04-16T03:25:45.387Z] TASK [Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected] ***
[2026-04-16T03:26:09.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (120 retries left).
[2026-04-16T03:26:09.091Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 minutes for an-test-deploy1 drbd storage to be disconnected (119 retries left).
[2026-04-16T03:26:09.091Z] ok: [an-a01dr01]
[2026-04-16T03:26:09.091Z] 
[2026-04-16T03:26:09.091Z] TASK [Reconnect an-test-deploy1 drbd storage] **********************************
[2026-04-16T03:26:13.164Z] changed: [an-a01dr01]
[2026-04-16T03:26:13.165Z] 
[2026-04-16T03:26:13.165Z] TASK [Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected] ***
[2026-04-16T03:26:36.860Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (120 retries left).
[2026-04-16T03:26:36.860Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 20 timeout for an-test-deploy1 drbd storage to be (re)connected (119 retries left).
[2026-04-16T03:26:36.860Z] ok: [an-a01dr01]
[2026-04-16T03:26:36.860Z] 
[2026-04-16T03:26:36.860Z] TASK [remove an-test-deploy1 protection sync] **********************************
[2026-04-16T03:26:40.122Z] changed: [an-a01dr01]
[2026-04-16T03:26:40.122Z] 
[2026-04-16T03:26:40.122Z] TASK [verify an-test-deploy1 DR drbd clean status sync] ************************
[2026-04-16T03:26:40.122Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_dr_clean.yml for an-a01dr01
[2026-04-16T03:26:40.122Z] 
[2026-04-16T03:26:40.122Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed] ****
[2026-04-16T03:27:14.183Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (60 retries left).
[2026-04-16T03:27:14.183Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (59 retries left).
[2026-04-16T03:27:14.183Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (58 retries left).
[2026-04-16T03:27:14.183Z] ok: [an-a01dr01]
[2026-04-16T03:27:14.183Z] 
[2026-04-16T03:27:14.183Z] TASK [Wait up to 10 minutes for an-test-deploy1 lvm volume to be removed] ******
[2026-04-16T03:27:25.493Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 lvm volume to be removed (60 retries left).
[2026-04-16T03:27:25.493Z] ok: [an-a01dr01]
[2026-04-16T03:27:25.493Z] 
[2026-04-16T03:27:25.493Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed] ***
[2026-04-16T03:27:59.560Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (60 retries left).
[2026-04-16T03:27:59.560Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (59 retries left).
[2026-04-16T03:27:59.560Z] FAILED - RETRYING: [an-a01dr01]: Wait up to 10 minutes for an-test-deploy1 drbd storage resource to be removed (58 retries left).
[2026-04-16T03:27:59.560Z] ok: [an-a01dr01]
[2026-04-16T03:27:59.560Z] 
[2026-04-16T03:27:59.560Z] TASK [check drbd sync status on nodes after disconnect sync] *******************
[2026-04-16T03:27:59.560Z] changed: [an-a01dr01 -> an-a01n01]
[2026-04-16T03:27:59.560Z] 
[2026-04-16T03:27:59.560Z] TASK [unlink DR vg from storage group] *****************************************
[2026-04-16T03:28:04.633Z] changed: [an-a01dr01]
[2026-04-16T03:28:04.633Z] 
[2026-04-16T03:28:04.633Z] TASK [verify DR vg is unlinked from storage group] *****************************
[2026-04-16T03:28:08.691Z] changed: [an-a01dr01]
[2026-04-16T03:28:08.691Z] 
[2026-04-16T03:28:08.691Z] TASK [unlink DR host from anvil] ***********************************************
[2026-04-16T03:28:13.764Z] changed: [an-a01dr01]
[2026-04-16T03:28:13.764Z] 
[2026-04-16T03:28:13.764Z] TASK [check no DR hosts are linked] ********************************************
[2026-04-16T03:28:18.836Z] changed: [an-a01dr01]
[2026-04-16T03:28:18.836Z] 
[2026-04-16T03:28:18.836Z] PLAY [upgrade server test] *****************************************************
[2026-04-16T03:28:18.836Z] 
[2026-04-16T03:28:18.836Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:28:20.654Z] ok: [an-a01n01]
[2026-04-16T03:28:20.654Z] ok: [an-a01n02]
[2026-04-16T03:28:20.654Z] 
[2026-04-16T03:28:20.654Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T03:28:20.654Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T03:28:20.654Z] 
[2026-04-16T03:28:20.654Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T03:28:24.713Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T03:28:24.713Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T03:28:24.713Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T03:28:24.713Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T03:28:24.713Z] 
[2026-04-16T03:28:24.713Z] TASK [check anvil-provision-server storage group] ******************************
[2026-04-16T03:28:24.713Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_storage_group.yml for an-a01n01, an-a01n02
[2026-04-16T03:28:24.713Z] 
[2026-04-16T03:28:24.713Z] TASK [get anvil-provision-server storage group] ********************************
[2026-04-16T03:28:29.785Z] changed: [an-a01n01]
[2026-04-16T03:28:29.785Z] changed: [an-a01n02]
[2026-04-16T03:28:29.785Z] 
[2026-04-16T03:28:29.785Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:28:29.785Z] included: /srv/anvil/anvil-test-suite/playbooks/common/get_install_iso.yml for an-a01n01, an-a01n02
[2026-04-16T03:28:29.785Z] 
[2026-04-16T03:28:29.785Z] TASK [check anvil-provision-server install isos] *******************************
[2026-04-16T03:28:34.855Z] changed: [an-a01n01]
[2026-04-16T03:28:34.855Z] changed: [an-a01n02]
[2026-04-16T03:28:34.855Z] 
[2026-04-16T03:28:34.855Z] TASK [deploy server 1 from "an-a01n01"] ****************************************
[2026-04-16T03:28:35.224Z] included: /srv/anvil/anvil-test-suite/playbooks/common/deploy_server.yml for an-a01n01, an-a01n02
[2026-04-16T03:28:35.224Z] 
[2026-04-16T03:28:35.224Z] TASK [check if server an-test-deploy1 exists] **********************************
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] ok: [an-a01n01]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [deploy server an-test-deploy1 from an-a01n01 on storage 7e16e733-13ad-4907-b29b-67e90ab06c92] ***
[2026-04-16T03:28:37.041Z] skipping: [an-a01n01]
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [Wait up to 10 minutes for an-test-deploy1 to be started in pacemaker] ****
[2026-04-16T03:28:37.041Z] skipping: [an-a01n01]
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T03:28:37.041Z] skipping: [an-a01n01]
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [Wait up to 10 minutes for an-test-deploy1 to start installation] *********
[2026-04-16T03:28:37.041Z] skipping: [an-a01n01]
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [Wait up to 10 minutes for an-test-deploy1 to complete installation] ******
[2026-04-16T03:28:37.041Z] skipping: [an-a01n01]
[2026-04-16T03:28:37.041Z] skipping: [an-a01n02]
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [check servers status] ****************************************************
[2026-04-16T03:28:37.041Z] included: /srv/anvil/anvil-test-suite/playbooks/common/server_started.yml for an-a01n01, an-a01n02
[2026-04-16T03:28:37.041Z] 
[2026-04-16T03:28:37.041Z] TASK [wait up to 20 minutes for servers to be Started] *************************
[2026-04-16T03:28:39.497Z] ok: [an-a01n01]
[2026-04-16T03:28:39.497Z] ok: [an-a01n02]
[2026-04-16T03:28:39.497Z] 
[2026-04-16T03:28:39.497Z] TASK [check servers are started all on the same node] **************************
[2026-04-16T03:28:41.316Z] ok: [an-a01n01]
[2026-04-16T03:28:41.317Z] ok: [an-a01n02]
[2026-04-16T03:28:41.317Z] 
[2026-04-16T03:28:41.317Z] PLAY [enable upgrade repo] *****************************************************
[2026-04-16T03:28:41.317Z] 
[2026-04-16T03:28:41.317Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:28:44.514Z] ok: [an-a01n01]
[2026-04-16T03:28:44.514Z] ok: [an-a01n02]
[2026-04-16T03:28:44.514Z] ok: [an-striker01]
[2026-04-16T03:28:44.514Z] ok: [an-striker02]
[2026-04-16T03:28:44.514Z] ok: [an-a01dr01]
[2026-04-16T03:28:44.514Z] 
[2026-04-16T03:28:44.514Z] TASK [enable anvil test-update repo] *******************************************
[2026-04-16T03:28:55.815Z] changed: [an-a01n01]
[2026-04-16T03:28:55.815Z] changed: [an-a01n02]
[2026-04-16T03:28:55.815Z] changed: [an-a01dr01]
[2026-04-16T03:28:55.815Z] changed: [an-striker02]
[2026-04-16T03:28:55.815Z] changed: [an-striker01]
[2026-04-16T03:28:55.815Z] 
[2026-04-16T03:28:55.815Z] TASK [store current uptime] ****************************************************
[2026-04-16T03:28:55.815Z] ok: [an-striker01]
[2026-04-16T03:28:55.815Z] ok: [an-striker02]
[2026-04-16T03:28:55.815Z] ok: [an-a01n01]
[2026-04-16T03:28:55.815Z] ok: [an-a01n02]
[2026-04-16T03:28:55.815Z] ok: [an-a01dr01]
[2026-04-16T03:28:55.815Z] 
[2026-04-16T03:28:55.815Z] PLAY [start upgrade process] ***************************************************
[2026-04-16T03:28:55.815Z] 
[2026-04-16T03:28:55.815Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T03:28:57.084Z] ok: [an-striker01]
[2026-04-16T03:28:57.084Z] 
[2026-04-16T03:28:57.085Z] TASK [upgrade and reboot all nodes but an-striker01] ***************************
[2026-04-16T03:59:53.216Z] changed: [an-striker01]
[2026-04-16T03:59:53.216Z] 
[2026-04-16T03:59:53.216Z] TASK [reboot striker01] ********************************************************
[2026-04-16T04:00:42.146Z] changed: [an-striker01]
[2026-04-16T04:00:42.146Z] 
[2026-04-16T04:00:42.146Z] PLAY [reconnect all nodes] *****************************************************
[2026-04-16T04:00:42.146Z] 
[2026-04-16T04:00:42.146Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:00:42.146Z] ok: [an-a01n02]
[2026-04-16T04:00:42.146Z] ok: [an-a01dr01]
[2026-04-16T04:00:42.146Z] ok: [an-striker01]
[2026-04-16T04:00:42.146Z] ok: [an-a01n01]
[2026-04-16T04:00:42.146Z] ok: [an-striker02]
[2026-04-16T04:00:42.146Z] 
[2026-04-16T04:00:42.146Z] TASK [wait for node "an-striker01" to be back online] **************************
[2026-04-16T04:00:42.146Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_node.yml for an-striker01, an-striker02, an-a01n01, an-a01n02, an-a01dr01
[2026-04-16T04:00:42.146Z] 
[2026-04-16T04:00:42.146Z] TASK [wait for node "all" to be back online] ***********************************
[2026-04-16T04:03:52.254Z] ok: [an-striker01 -> localhost]
[2026-04-16T04:03:52.254Z] ok: [an-a01n01 -> localhost]
[2026-04-16T04:03:52.254Z] ok: [an-striker02 -> localhost]
[2026-04-16T04:03:52.254Z] ok: [an-a01n02 -> localhost]
[2026-04-16T04:03:52.254Z] ok: [an-a01dr01 -> localhost]
[2026-04-16T04:03:52.254Z] 
[2026-04-16T04:03:52.254Z] TASK [check nodes uptime after reboot] *****************************************
[2026-04-16T04:03:52.254Z] changed: [an-a01n01]
[2026-04-16T04:03:52.254Z] changed: [an-a01n02]
[2026-04-16T04:03:52.254Z] changed: [an-a01dr01]
[2026-04-16T04:03:52.254Z] changed: [an-striker01]
[2026-04-16T04:03:52.254Z] changed: [an-striker02]
[2026-04-16T04:03:52.254Z] 
[2026-04-16T04:03:52.254Z] PLAY [check all nodes status after upgrade] ************************************
[2026-04-16T04:03:52.254Z] 
[2026-04-16T04:03:52.254Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:03:54.947Z] ok: [an-a01dr01]
[2026-04-16T04:03:54.947Z] ok: [an-a01n01]
[2026-04-16T04:03:54.947Z] ok: [an-a01n02]
[2026-04-16T04:03:54.947Z] ok: [an-striker02]
[2026-04-16T04:03:54.947Z] ok: [an-striker01]
[2026-04-16T04:03:54.947Z] 
[2026-04-16T04:03:54.947Z] TASK [check perl-Log-Journald package version] *********************************
[2026-04-16T04:03:57.412Z] changed: [an-a01n02]
[2026-04-16T04:03:57.412Z] changed: [an-a01dr01]
[2026-04-16T04:03:57.412Z] changed: [an-a01n01]
[2026-04-16T04:03:57.412Z] changed: [an-striker01]
[2026-04-16T04:03:57.412Z] changed: [an-striker02]
[2026-04-16T04:03:57.412Z] 
[2026-04-16T04:03:57.412Z] PLAY [check nodes status after upgrade] ****************************************
[2026-04-16T04:03:57.412Z] 
[2026-04-16T04:03:57.412Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:03:59.238Z] ok: [an-a01dr01]
[2026-04-16T04:03:59.238Z] ok: [an-a01n02]
[2026-04-16T04:03:59.238Z] ok: [an-a01n01]
[2026-04-16T04:03:59.238Z] 
[2026-04-16T04:03:59.238Z] TASK [check kmod-drdb package version] *****************************************
[2026-04-16T04:04:01.065Z] changed: [an-a01dr01]
[2026-04-16T04:04:01.065Z] changed: [an-a01n01]
[2026-04-16T04:04:01.065Z] changed: [an-a01n02]
[2026-04-16T04:04:01.065Z] 
[2026-04-16T04:04:01.065Z] PLAY [check hosted node status after upgrade] **********************************
[2026-04-16T04:04:01.065Z] 
[2026-04-16T04:04:01.065Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:04:02.891Z] ok: [an-a01n02]
[2026-04-16T04:04:02.891Z] ok: [an-a01n01]
[2026-04-16T04:04:02.891Z] 
[2026-04-16T04:04:02.891Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T04:04:02.891Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T04:04:02.891Z] 
[2026-04-16T04:04:02.891Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T04:04:06.963Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T04:04:06.963Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T04:04:06.963Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T04:04:06.963Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T04:04:06.963Z] 
[2026-04-16T04:04:06.963Z] TASK [wait servers to be started in pacemaker] *********************************
[2026-04-16T04:04:06.963Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_in_pacemaker.yml for an-a01n01, an-a01n02
[2026-04-16T04:04:06.963Z] 
[2026-04-16T04:04:06.963Z] TASK [Wait up to 10 minutes for an-test-deploy1 to be started in pacemaker] ****
[2026-04-16T04:04:08.790Z] ok: [an-a01n01]
[2026-04-16T04:04:08.790Z] ok: [an-a01n02]
[2026-04-16T04:04:08.790Z] 
[2026-04-16T04:04:08.790Z] TASK [wait servers drbd storage to be synced] **********************************
[2026-04-16T04:04:08.790Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_drbd_sync.yml for an-a01n01, an-a01n02
[2026-04-16T04:04:08.790Z] 
[2026-04-16T04:04:08.790Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be synced] *****
[2026-04-16T04:04:09.161Z] ok: [an-a01n02]
[2026-04-16T04:04:09.161Z] ok: [an-a01n01]
[2026-04-16T04:04:09.161Z] 
[2026-04-16T04:04:09.161Z] TASK [wait servers to respond to ping] *****************************************
[2026-04-16T04:04:09.532Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ping.yml for an-a01n01, an-a01n02
[2026-04-16T04:04:09.532Z] 
[2026-04-16T04:04:09.532Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ping] ************
[2026-04-16T04:04:10.326Z] ok: [an-a01n01]
[2026-04-16T04:04:10.326Z] ok: [an-a01n02]
[2026-04-16T04:04:10.326Z] 
[2026-04-16T04:04:10.326Z] TASK [wait servers to respond to ssh] ******************************************
[2026-04-16T04:04:10.326Z] included: /srv/anvil/anvil-test-suite/playbooks/common/wait_server_ssh.yml for an-a01n01, an-a01n02
[2026-04-16T04:04:10.326Z] 
[2026-04-16T04:04:10.326Z] TASK [Wait up to 10 minutes for an-test-deploy1 to respond to ssh] *************
[2026-04-16T04:04:11.118Z] ok: [an-a01n01]
[2026-04-16T04:04:11.118Z] ok: [an-a01n02]
[2026-04-16T04:04:11.118Z] 
[2026-04-16T04:04:11.118Z] PLAY [test anvil package self update] ******************************************
[2026-04-16T04:04:11.118Z] 
[2026-04-16T04:04:11.118Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:04:14.108Z] ok: [an-a01n01]
[2026-04-16T04:04:14.108Z] ok: [an-a01n02]
[2026-04-16T04:04:14.108Z] ok: [an-a01dr01]
[2026-04-16T04:04:14.108Z] ok: [an-striker02]
[2026-04-16T04:04:14.108Z] ok: [an-striker01]
[2026-04-16T04:04:14.108Z] 
[2026-04-16T04:04:14.108Z] TASK [stop anvil and scan-core services] ***************************************
[2026-04-16T04:04:19.196Z] changed: [an-a01n01] => (item=anvil-daemon.service)
[2026-04-16T04:04:19.196Z] changed: [an-a01n02] => (item=anvil-daemon.service)
[2026-04-16T04:04:19.196Z] changed: [an-a01dr01] => (item=anvil-daemon.service)
[2026-04-16T04:04:19.196Z] changed: [an-striker02] => (item=anvil-daemon.service)
[2026-04-16T04:04:19.196Z] changed: [an-a01n01] => (item=scancore.service)
[2026-04-16T04:04:19.196Z] changed: [an-a01dr01] => (item=scancore.service)
[2026-04-16T04:04:19.196Z] changed: [an-a01n02] => (item=scancore.service)
[2026-04-16T04:04:19.196Z] changed: [an-striker01] => (item=anvil-daemon.service)
[2026-04-16T04:04:19.196Z] changed: [an-striker02] => (item=scancore.service)
[2026-04-16T04:04:19.196Z] changed: [an-striker01] => (item=scancore.service)
[2026-04-16T04:04:19.196Z] 
[2026-04-16T04:04:19.196Z] PLAY [test striker package self update] ****************************************
[2026-04-16T04:04:19.196Z] 
[2026-04-16T04:04:19.196Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:04:19.988Z] ok: [an-striker01]
[2026-04-16T04:04:19.988Z] ok: [an-striker02]
[2026-04-16T04:04:19.988Z] 
[2026-04-16T04:04:19.988Z] TASK [reinstall anvil-core and anvil-striker] **********************************
[2026-04-16T04:04:48.443Z] changed: [an-striker02]
[2026-04-16T04:04:48.443Z] changed: [an-striker01]
[2026-04-16T04:04:48.443Z] 
[2026-04-16T04:04:48.443Z] PLAY [test node package self update] *******************************************
[2026-04-16T04:04:48.443Z] 
[2026-04-16T04:04:48.443Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:04:48.443Z] ok: [an-a01n02]
[2026-04-16T04:04:48.443Z] ok: [an-a01n01]
[2026-04-16T04:04:48.443Z] 
[2026-04-16T04:04:48.443Z] TASK [reinstall anvil-core and anvil-node] *************************************
[2026-04-16T04:05:12.527Z] changed: [an-a01n02]
[2026-04-16T04:05:12.527Z] changed: [an-a01n01]
[2026-04-16T04:05:12.527Z] 
[2026-04-16T04:05:12.527Z] PLAY [test dr package self update] *********************************************
[2026-04-16T04:05:12.527Z] 
[2026-04-16T04:05:12.527Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:05:13.319Z] ok: [an-a01dr01]
[2026-04-16T04:05:13.319Z] 
[2026-04-16T04:05:13.319Z] TASK [reinstall anvil-core and anvil-dr] ***************************************
[2026-04-16T04:05:41.776Z] changed: [an-a01dr01]
[2026-04-16T04:05:41.776Z] 
[2026-04-16T04:05:41.776Z] PLAY [test anvil package self update] ******************************************
[2026-04-16T04:05:41.776Z] 
[2026-04-16T04:05:41.776Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:05:41.776Z] ok: [an-striker01]
[2026-04-16T04:05:41.776Z] ok: [an-a01n01]
[2026-04-16T04:05:41.776Z] ok: [an-striker02]
[2026-04-16T04:05:41.776Z] ok: [an-a01n02]
[2026-04-16T04:05:41.776Z] ok: [an-a01dr01]
[2026-04-16T04:05:41.776Z] 
[2026-04-16T04:05:41.776Z] TASK [start anvil and scan-core services] **************************************
[2026-04-16T04:05:41.776Z] changed: [an-a01n01] => (item=anvil-daemon.service)
[2026-04-16T04:05:41.776Z] changed: [an-a01n02] => (item=anvil-daemon.service)
[2026-04-16T04:05:41.776Z] changed: [an-a01dr01] => (item=anvil-daemon.service)
[2026-04-16T04:05:41.776Z] changed: [an-striker01] => (item=anvil-daemon.service)
[2026-04-16T04:05:41.776Z] changed: [an-striker02] => (item=anvil-daemon.service)
[2026-04-16T04:05:41.776Z] changed: [an-a01n01] => (item=scancore.service)
[2026-04-16T04:05:41.776Z] changed: [an-a01n02] => (item=scancore.service)
[2026-04-16T04:05:41.776Z] changed: [an-a01dr01] => (item=scancore.service)
[2026-04-16T04:05:41.776Z] changed: [an-striker02] => (item=scancore.service)
[2026-04-16T04:05:41.776Z] changed: [an-striker01] => (item=scancore.service)
[2026-04-16T04:05:41.776Z] 
[2026-04-16T04:05:41.776Z] PLAY [delete server tests] *****************************************************
[2026-04-16T04:05:41.776Z] 
[2026-04-16T04:05:41.776Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:05:43.631Z] ok: [an-a01n01]
[2026-04-16T04:05:43.631Z] ok: [an-a01n02]
[2026-04-16T04:05:43.631Z] 
[2026-04-16T04:05:43.631Z] TASK [check cluster is in good state] ******************************************
[2026-04-16T04:05:44.002Z] included: /srv/anvil/anvil-test-suite/playbooks/common/cluster_good.yml for an-a01n01, an-a01n02
[2026-04-16T04:05:44.002Z] 
[2026-04-16T04:05:44.002Z] TASK [wait up to 10 minutes for nodes to be in pacemaker cluster] **************
[2026-04-16T04:05:48.076Z] ok: [an-a01n01] => (item=an-a01n01)
[2026-04-16T04:05:48.076Z] ok: [an-a01n02] => (item=an-a01n01)
[2026-04-16T04:05:48.076Z] ok: [an-a01n01] => (item=an-a01n02)
[2026-04-16T04:05:48.076Z] ok: [an-a01n02] => (item=an-a01n02)
[2026-04-16T04:05:48.076Z] 
[2026-04-16T04:05:48.076Z] TASK [delete servers] **********************************************************
[2026-04-16T04:05:48.076Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=1)
[2026-04-16T04:05:48.076Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=2)
[2026-04-16T04:05:48.076Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=3)
[2026-04-16T04:05:48.076Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=4)
[2026-04-16T04:05:48.076Z] included: /srv/anvil/anvil-test-suite/playbooks/common/delete_server.yml for an-a01n01, an-a01n02 => (item=5)
[2026-04-16T04:05:48.076Z] 
[2026-04-16T04:05:48.076Z] TASK [check if server an-test-deploy1 exists] **********************************
[2026-04-16T04:05:49.902Z] skipping: [an-a01n01]
[2026-04-16T04:05:49.902Z] ok: [an-a01n02]
[2026-04-16T04:05:49.902Z] 
[2026-04-16T04:05:49.902Z] TASK [delete server an-test-deploy1 from an-a01n02] ****************************
[2026-04-16T04:05:57.592Z] skipping: [an-a01n01]
[2026-04-16T04:05:57.592Z] changed: [an-a01n02]
[2026-04-16T04:05:57.592Z] 
[2026-04-16T04:05:57.592Z] TASK [Wait up to 10 minutes for an-test-deploy1 to be delete in pacemaker] *****
[2026-04-16T04:06:46.777Z] skipping: [an-a01n01]
[2026-04-16T04:06:46.777Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to be delete in pacemaker (60 retries left).
[2026-04-16T04:06:46.777Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to be delete in pacemaker (59 retries left).
[2026-04-16T04:06:46.777Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to be delete in pacemaker (58 retries left).
[2026-04-16T04:06:46.777Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 to be delete in pacemaker (57 retries left).
[2026-04-16T04:06:46.777Z] ok: [an-a01n02]
[2026-04-16T04:06:46.777Z] 
[2026-04-16T04:06:46.777Z] TASK [Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed] ****
[2026-04-16T04:06:58.103Z] skipping: [an-a01n01]
[2026-04-16T04:06:58.103Z] FAILED - RETRYING: [an-a01n02]: Wait up to 10 minutes for an-test-deploy1 drbd storage to be removed (60 retries left).
[2026-04-16T04:06:58.103Z] ok: [an-a01n02]
[2026-04-16T04:06:58.103Z] 
[2026-04-16T04:06:58.103Z] TASK [Wait up to 10 minutes for an-test-deploy1 lvm volume to be removed] ******
[2026-04-16T04:06:58.103Z] skipping: [an-a01n01]
[2026-04-16T04:06:58.103Z] ok: [an-a01n02]
[2026-04-16T04:06:58.103Z] 
[2026-04-16T04:06:58.103Z] TASK [check if server an-test-deploy2 exists] **********************************
[2026-04-16T04:06:58.895Z] skipping: [an-a01n01]
[2026-04-16T04:06:58.895Z] fatal: [an-a01n02]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy2\n", "delta": "0:00:01.001125", "end": "2026-04-16 00:06:58.759667", "msg": "non-zero return code", "rc": 1, "start": "2026-04-16 00:06:57.758542", "stderr": "Error: resource or tag id 'an-test-deploy2' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy2' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T04:06:58.895Z] ...ignoring
[2026-04-16T04:06:58.895Z] 
[2026-04-16T04:06:58.895Z] TASK [delete server an-test-deploy2 from an-a01n02] ****************************
[2026-04-16T04:06:59.267Z] skipping: [an-a01n01]
[2026-04-16T04:06:59.267Z] skipping: [an-a01n02]
[2026-04-16T04:06:59.267Z] 
[2026-04-16T04:06:59.267Z] TASK [Wait up to 10 minutes for an-test-deploy2 to be delete in pacemaker] *****
[2026-04-16T04:06:59.267Z] skipping: [an-a01n01]
[2026-04-16T04:06:59.267Z] skipping: [an-a01n02]
[2026-04-16T04:06:59.267Z] 
[2026-04-16T04:06:59.267Z] TASK [Wait up to 10 minutes for an-test-deploy2 drbd storage to be removed] ****
[2026-04-16T04:06:59.267Z] skipping: [an-a01n01]
[2026-04-16T04:06:59.267Z] skipping: [an-a01n02]
[2026-04-16T04:06:59.267Z] 
[2026-04-16T04:06:59.267Z] TASK [Wait up to 10 minutes for an-test-deploy2 lvm volume to be removed] ******
[2026-04-16T04:06:59.267Z] skipping: [an-a01n01]
[2026-04-16T04:06:59.267Z] skipping: [an-a01n02]
[2026-04-16T04:06:59.267Z] 
[2026-04-16T04:06:59.267Z] TASK [check if server an-test-deploy3 exists] **********************************
[2026-04-16T04:07:01.099Z] skipping: [an-a01n01]
[2026-04-16T04:07:01.099Z] fatal: [an-a01n02]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy3\n", "delta": "0:00:00.941424", "end": "2026-04-16 00:07:00.664223", "msg": "non-zero return code", "rc": 1, "start": "2026-04-16 00:06:59.722799", "stderr": "Error: resource or tag id 'an-test-deploy3' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy3' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T04:07:01.099Z] ...ignoring
[2026-04-16T04:07:01.099Z] 
[2026-04-16T04:07:01.099Z] TASK [delete server an-test-deploy3 from an-a01n02] ****************************
[2026-04-16T04:07:01.099Z] skipping: [an-a01n01]
[2026-04-16T04:07:01.099Z] skipping: [an-a01n02]
[2026-04-16T04:07:01.099Z] 
[2026-04-16T04:07:01.099Z] TASK [Wait up to 10 minutes for an-test-deploy3 to be delete in pacemaker] *****
[2026-04-16T04:07:01.099Z] skipping: [an-a01n01]
[2026-04-16T04:07:01.099Z] skipping: [an-a01n02]
[2026-04-16T04:07:01.099Z] 
[2026-04-16T04:07:01.099Z] TASK [Wait up to 10 minutes for an-test-deploy3 drbd storage to be removed] ****
[2026-04-16T04:07:01.099Z] skipping: [an-a01n01]
[2026-04-16T04:07:01.099Z] skipping: [an-a01n02]
[2026-04-16T04:07:01.099Z] 
[2026-04-16T04:07:01.099Z] TASK [Wait up to 10 minutes for an-test-deploy3 lvm volume to be removed] ******
[2026-04-16T04:07:01.099Z] skipping: [an-a01n01]
[2026-04-16T04:07:01.099Z] skipping: [an-a01n02]
[2026-04-16T04:07:01.099Z] 
[2026-04-16T04:07:01.099Z] TASK [check if server an-test-deploy4 exists] **********************************
[2026-04-16T04:07:02.934Z] skipping: [an-a01n01]
[2026-04-16T04:07:02.934Z] fatal: [an-a01n02]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy4\n", "delta": "0:00:00.944157", "end": "2026-04-16 00:07:02.522136", "msg": "non-zero return code", "rc": 1, "start": "2026-04-16 00:07:01.577979", "stderr": "Error: resource or tag id 'an-test-deploy4' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy4' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T04:07:02.934Z] ...ignoring
[2026-04-16T04:07:02.934Z] 
[2026-04-16T04:07:02.934Z] TASK [delete server an-test-deploy4 from an-a01n02] ****************************
[2026-04-16T04:07:02.934Z] skipping: [an-a01n01]
[2026-04-16T04:07:02.934Z] skipping: [an-a01n02]
[2026-04-16T04:07:02.934Z] 
[2026-04-16T04:07:02.934Z] TASK [Wait up to 10 minutes for an-test-deploy4 to be delete in pacemaker] *****
[2026-04-16T04:07:02.934Z] skipping: [an-a01n01]
[2026-04-16T04:07:02.934Z] skipping: [an-a01n02]
[2026-04-16T04:07:02.934Z] 
[2026-04-16T04:07:02.934Z] TASK [Wait up to 10 minutes for an-test-deploy4 drbd storage to be removed] ****
[2026-04-16T04:07:02.934Z] skipping: [an-a01n01]
[2026-04-16T04:07:02.934Z] skipping: [an-a01n02]
[2026-04-16T04:07:02.934Z] 
[2026-04-16T04:07:02.934Z] TASK [Wait up to 10 minutes for an-test-deploy4 lvm volume to be removed] ******
[2026-04-16T04:07:03.305Z] skipping: [an-a01n01]
[2026-04-16T04:07:03.305Z] skipping: [an-a01n02]
[2026-04-16T04:07:03.305Z] 
[2026-04-16T04:07:03.305Z] TASK [check if server an-test-deploy5 exists] **********************************
[2026-04-16T04:07:04.578Z] skipping: [an-a01n01]
[2026-04-16T04:07:04.578Z] fatal: [an-a01n02]: FAILED! => {"changed": false, "cmd": "pcs status resources an-test-deploy5\n", "delta": "0:00:00.944537", "end": "2026-04-16 00:07:04.447328", "msg": "non-zero return code", "rc": 1, "start": "2026-04-16 00:07:03.502791", "stderr": "Error: resource or tag id 'an-test-deploy5' not found", "stderr_lines": ["Error: resource or tag id 'an-test-deploy5' not found"], "stdout": "", "stdout_lines": []}
[2026-04-16T04:07:04.578Z] ...ignoring
[2026-04-16T04:07:04.578Z] 
[2026-04-16T04:07:04.578Z] TASK [delete server an-test-deploy5 from an-a01n02] ****************************
[2026-04-16T04:07:04.949Z] skipping: [an-a01n01]
[2026-04-16T04:07:04.949Z] skipping: [an-a01n02]
[2026-04-16T04:07:04.949Z] 
[2026-04-16T04:07:04.949Z] TASK [Wait up to 10 minutes for an-test-deploy5 to be delete in pacemaker] *****
[2026-04-16T04:07:04.949Z] skipping: [an-a01n01]
[2026-04-16T04:07:04.949Z] skipping: [an-a01n02]
[2026-04-16T04:07:04.949Z] 
[2026-04-16T04:07:04.949Z] TASK [Wait up to 10 minutes for an-test-deploy5 drbd storage to be removed] ****
[2026-04-16T04:07:04.949Z] skipping: [an-a01n01]
[2026-04-16T04:07:04.949Z] skipping: [an-a01n02]
[2026-04-16T04:07:04.949Z] 
[2026-04-16T04:07:04.949Z] TASK [Wait up to 10 minutes for an-test-deploy5 lvm volume to be removed] ******
[2026-04-16T04:07:04.949Z] skipping: [an-a01n01]
[2026-04-16T04:07:04.949Z] skipping: [an-a01n02]
[2026-04-16T04:07:04.949Z] 
[2026-04-16T04:07:04.949Z] PLAY [Check anvil available resources from striker01] **************************
[2026-04-16T04:07:04.949Z] 
[2026-04-16T04:07:04.949Z] TASK [Gathering Facts] *********************************************************
[2026-04-16T04:07:07.648Z] ok: [an-striker01]
[2026-04-16T04:07:07.649Z] 
[2026-04-16T04:07:07.649Z] TASK [Check anvil available resources] *****************************************
[2026-04-16T04:12:19.307Z] ok: [an-striker01]
[2026-04-16T04:12:19.307Z] 
[2026-04-16T04:12:19.307Z] PLAY RECAP *********************************************************************
[2026-04-16T04:12:19.307Z] an-a01dr01                 : ok=90   changed=38   unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   
[2026-04-16T04:12:19.307Z] an-a01n01                  : ok=314  changed=28   unreachable=0    failed=0    skipped=109  rescued=0    ignored=5   
[2026-04-16T04:12:19.307Z] an-a01n02                  : ok=345  changed=27   unreachable=0    failed=0    skipped=90   rescued=0    ignored=4   
[2026-04-16T04:12:19.307Z] an-striker01               : ok=57   changed=19   unreachable=0    failed=0    skipped=3    rescued=0    ignored=0   
[2026-04-16T04:12:19.307Z] an-striker02               : ok=42   changed=12   unreachable=0    failed=0    skipped=3    rescued=0    ignored=0   
[2026-04-16T04:12:19.307Z] 
[2026-04-16T04:12:19.307Z] tar: Removing leading `/' from member names
[2026-04-16T04:12:19.307Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-16T04:12:19.307Z] /root/ci-tools
[2026-04-16T04:12:19.307Z] Complete anvil logs available here for download: http://anvil-ci-repo.ci.alteeve.com/testing-logs/334.tar.gz
[2026-04-16T04:12:19.307Z] Disconnecting an-striker01.ci.alteeve.com from Red Hat.
[2026-04-16T04:12:19.307Z] This might take a few seconds.
[2026-04-16T04:12:19.307Z] 
[2026-04-16T04:12:19.307Z] 𐄂 Deactivated the Remote Host Configuration daemon
[2026-04-16T04:12:21.133Z] 𐄂 Disconnected from Red Hat Insights
[2026-04-16T04:12:22.407Z] 𐄂 Disconnected from Red Hat Subscription Management
[2026-04-16T04:12:22.407Z] 
[2026-04-16T04:12:22.407Z] Manage your connected systems: https://red.ht/connector
[2026-04-16T04:12:28.690Z] This host is unregistered, please ensure that the system is registered with subscription-manager and then with insights-client.
[2026-04-16T04:12:28.690Z] 
[2026-04-16T04:12:28.690Z] 1. Register with subscription-manager
[2026-04-16T04:12:28.690Z] # subscription-manager register
[2026-04-16T04:12:28.690Z] 
[2026-04-16T04:12:28.690Z] 2. Register with insights-client
[2026-04-16T04:12:28.690Z] # insights-client --register
[2026-04-16T04:12:29.061Z] This system is currently not registered.
[2026-04-16T04:12:29.432Z] Disconnecting an-striker02.ci.alteeve.com from Red Hat.
[2026-04-16T04:12:29.432Z] This might take a few seconds.
[2026-04-16T04:12:29.432Z] 
[2026-04-16T04:12:29.432Z] 𐄂 Deactivated the Remote Host Configuration daemon
[2026-04-16T04:12:35.712Z] 𐄂 Disconnected from Red Hat Insights
[2026-04-16T04:12:36.510Z] 𐄂 Disconnected from Red Hat Subscription Management
[2026-04-16T04:12:36.510Z] 
[2026-04-16T04:12:36.510Z] Manage your connected systems: https://red.ht/connector
[2026-04-16T04:12:41.948Z] This host is unregistered, please ensure that the system is registered with subscription-manager and then with insights-client.
[2026-04-16T04:12:41.948Z] 
[2026-04-16T04:12:41.948Z] 1. Register with subscription-manager
[2026-04-16T04:12:41.948Z] # subscription-manager register
[2026-04-16T04:12:41.948Z] 
[2026-04-16T04:12:41.948Z] 2. Register with insights-client
[2026-04-16T04:12:41.948Z] # insights-client --register
[2026-04-16T04:12:42.740Z] This system is currently not registered.
[2026-04-16T04:12:43.111Z] Disconnecting an-a01n01.ci.alteeve.com from Red Hat.
[2026-04-16T04:12:43.111Z] This might take a few seconds.
[2026-04-16T04:12:43.111Z] 
[2026-04-16T04:12:43.111Z] 𐄂 Deactivated the Remote Host Configuration daemon
[2026-04-16T04:12:49.390Z] 𐄂 Disconnected from Red Hat Insights
[2026-04-16T04:12:49.390Z] 𐄂 Disconnected from Red Hat Subscription Management
[2026-04-16T04:12:49.390Z] 
[2026-04-16T04:12:49.390Z] Manage your connected systems: https://red.ht/connector
[2026-04-16T04:12:54.477Z] This host is unregistered, please ensure that the system is registered with subscription-manager and then with insights-client.
[2026-04-16T04:12:54.477Z] 
[2026-04-16T04:12:54.477Z] 1. Register with subscription-manager
[2026-04-16T04:12:54.477Z] # subscription-manager register
[2026-04-16T04:12:54.477Z] 
[2026-04-16T04:12:54.477Z] 2. Register with insights-client
[2026-04-16T04:12:54.477Z] # insights-client --register
[2026-04-16T04:12:54.848Z] This system is currently not registered.
[2026-04-16T04:12:55.640Z] Disconnecting an-a01n02.ci.alteeve.com from Red Hat.
[2026-04-16T04:12:55.640Z] This might take a few seconds.
[2026-04-16T04:12:55.640Z] 
[2026-04-16T04:12:55.640Z] 𐄂 Deactivated the Remote Host Configuration daemon
[2026-04-16T04:13:01.077Z] 𐄂 Disconnected from Red Hat Insights
[2026-04-16T04:13:01.868Z] 𐄂 Disconnected from Red Hat Subscription Management
[2026-04-16T04:13:01.868Z] 
[2026-04-16T04:13:01.868Z] Manage your connected systems: https://red.ht/connector
[2026-04-16T04:13:06.961Z] This host is unregistered, please ensure that the system is registered with subscription-manager and then with insights-client.
[2026-04-16T04:13:06.961Z] 
[2026-04-16T04:13:06.961Z] 1. Register with subscription-manager
[2026-04-16T04:13:06.961Z] # subscription-manager register
[2026-04-16T04:13:06.961Z] 
[2026-04-16T04:13:06.961Z] 2. Register with insights-client
[2026-04-16T04:13:06.961Z] # insights-client --register
[2026-04-16T04:13:07.332Z] This system is currently not registered.
[2026-04-16T04:13:08.125Z] Disconnecting an-a01dr01.ci.alteeve.com from Red Hat.
[2026-04-16T04:13:08.125Z] This might take a few seconds.
[2026-04-16T04:13:08.125Z] 
[2026-04-16T04:13:08.125Z] 𐄂 Deactivated the Remote Host Configuration daemon
[2026-04-16T04:13:14.411Z] 𐄂 Disconnected from Red Hat Insights
[2026-04-16T04:13:14.411Z] 𐄂 Disconnected from Red Hat Subscription Management
[2026-04-16T04:13:14.411Z] 
[2026-04-16T04:13:14.411Z] Manage your connected systems: https://red.ht/connector
[2026-04-16T04:13:19.504Z] This host is unregistered, please ensure that the system is registered with subscription-manager and then with insights-client.
[2026-04-16T04:13:19.504Z] 
[2026-04-16T04:13:19.504Z] 1. Register with subscription-manager
[2026-04-16T04:13:19.504Z] # subscription-manager register
[2026-04-16T04:13:19.504Z] 
[2026-04-16T04:13:19.504Z] 2. Register with insights-client
[2026-04-16T04:13:19.504Z] # insights-client --register
[2026-04-16T04:13:20.298Z] This system is currently not registered.
[2026-04-16T04:13:20.683Z] [Pipeline] }
[2026-04-16T04:13:20.686Z] [Pipeline] // timeout
[2026-04-16T04:13:20.689Z] [Pipeline] }
[2026-04-16T04:13:20.691Z] [Pipeline] // script
[2026-04-16T04:13:20.693Z] [Pipeline] }
[2026-04-16T04:13:20.694Z] [Pipeline] // stage
[2026-04-16T04:13:20.697Z] [Pipeline] stage
[2026-04-16T04:13:20.698Z] [Pipeline] { (Declarative: Post Actions)
[2026-04-16T04:13:20.703Z] [Pipeline] cleanWs
[2026-04-16T04:13:20.766Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-16T04:13:20.766Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-16T04:13:20.804Z] [WS-CLEANUP] done
[2026-04-16T04:13:20.807Z] [Pipeline] script
[2026-04-16T04:13:20.809Z] [Pipeline] {
[2026-04-16T04:13:20.823Z] [Pipeline] stage
[2026-04-16T04:13:20.824Z] [Pipeline] { (Copying logs)
[2026-04-16T04:13:20.854Z] [Pipeline] node
[2026-04-16T04:13:20.860Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing
[2026-04-16T04:13:20.861Z] [Pipeline] {
[2026-04-16T04:13:20.894Z] [Pipeline] node
[2026-04-16T04:13:20.901Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-functional-testing@2
[2026-04-16T04:13:20.901Z] [Pipeline] {
[2026-04-16T04:13:20.904Z] [Pipeline] sh
[2026-04-16T04:13:21.160Z] + mkdir -p /var/lib/jenkins/locks
[2026-04-16T04:13:21.167Z] [Pipeline] echo
[2026-04-16T04:13:21.168Z] RWLock: FD for lock log_archive in stage projectFinishUp is 387
[2026-04-16T04:13:21.170Z] [Pipeline] sleep
[2026-04-16T04:13:21.171Z] No need to sleep any longer
[2026-04-16T04:13:21.173Z] [Pipeline] echo
[2026-04-16T04:13:21.173Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-04-16T04:13:21.176Z] [Pipeline] }
[2026-04-16T04:13:21.178Z] [Pipeline] // node
[2026-04-16T04:13:21.181Z] [Pipeline] echo
[2026-04-16T04:13:21.181Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-functional-testing/334/
[2026-04-16T04:13:21.181Z] [Pipeline] sh
[2026-04-16T04:13:21.436Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-functional-testing/334/
[2026-04-16T04:13:21.438Z] [Pipeline] sh