Written by

Malaya Acharya

Question Malaya Acharya · Mar 23

I am trying to create an application consistent snapshot using the following script but always getting WIJ mismatch error.Please suggest.

#InterSystems IRIS

SetUp:

vIris instance created on Production Host i.e. Host1 on local mount point based on local disk.

vA single LVM is created out of 20 PVOLs and mapped to a mount point directory for IRIS database on both hosts.

vA single LVM is created out of 5 PVOLs and mapped to a mount point directory for WIJ on both hosts.

vA single LVM is created out of 5 PVOLs and mapped to a mount point directory for Journal on both hosts.

On Host-1

Created tables on the IRIS database on Host1.

vStart insert operation on the database.

vPerform DB freeze with command IRIS freeze

vCheck DB freeze status with WDSUSPD parameter in “iris stat” command.

vWait for 180 sec

vPerform XFS freeze.

vDo Snapshot create operation with WIJ, IRIS DB and JOURNAL on PVOLs specifying SVOLs and CTG.

vPerform XFS unfreeze

vPerform DB thaw.

vWait for PSUS status.

vActivate the VG on Secondary Host i.e. Host2

vOnce VG is activated, mount the all the LVMs for database on the mount point.

vStart the IRIS instance.

vstance WIJ Mismatch error occurred and asked to go to Single use mode .

Log is as follows:

=================================================
IRIS Snapshot Restore Automation Started
Mon Mar 23 07:06:06 AM UTC 2026
=================================================
=================================================
0. Pre-Check & Creating Snapshot Pairs via RAIDCOM
=================================================
Snapshots present:
Get pool
PID POLS U(%) SSCNT Available(MB) Capacity(MB) Seq# Num LDEV# H(%) FMT_CAP(MB)
000 POLN 26 207 22432956 30511740 810019 24 48896 80 22432956
Mon Mar 23 07:06:12 AM UTC 2026: Pair command fired
10 30 0 MP-0
11 31 0 MP-0
12 32 0 MP-0
13 33 0 MP-0
14 34 0 MP-0
15 35 0 MP-0
16 36 0 MP-0
17 37 0 MP-0
18 38 0 MP-0
19 39 0 MP-0
20 40 0 MP-0
21 41 0 MP-0
22 42 0 MP-0
23 43 0 MP-0
24 44 0 MP-0
25 45 0 MP-0
26 46 0 MP-0
27 47 0 MP-0
28 48 0 MP-0
29 49 0 MP-0
70 180 0 MP-0
71 181 0 MP-0
72 182 0 MP-0
73 183 0 MP-0
74 184 0 MP-0
75 185 0 MP-0
76 186 0 MP-0
77 187 0 MP-0
78 188 0 MP-0
79 189 0 MP-0
Mon Mar 23 07:06:18 AM UTC 2026: Command complete
Mon Mar 23 07:06:32 AM UTC 2026: Pair complete
SnapShot_name P/S STAT Serial# LDEV# MU# P-LDEV# PID % MODE SPLT-TIME
MP-0 - - 810019 - - - - - ---- -
SnapShot_name P/S STAT Serial# LDEV# MU# P-LDEV# PID % MODE SPLT-TIME SLU C_LDEV# P R D_STAT RETENTION(H)
MP-0 P-VOL PAIR 810019 10 3 30 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 11 3 31 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 12 3 32 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 13 3 33 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 14 3 34 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 15 3 35 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 16 3 36 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 17 3 37 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 18 3 38 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 19 3 39 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 20 3 40 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 21 3 41 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 22 3 42 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 23 3 43 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 24 3 44 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 25 3 45 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 26 3 46 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 27 3 47 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 28 3 48 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 29 3 49 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 70 3 180 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 71 3 181 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 72 3 182 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 73 3 183 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 74 3 184 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 75 3 185 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 76 3 186 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 77 3 187 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 78 3 188 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 79 3 189 0 - G--AR------- - - - N D PAIR -
=================================================
1. Checking IRIS Status
=================================================

Configuration 'IRIS'
directory: /IRIS
versionid: 2025.2.0.227.0com
datadir: /IRIS
conf file: iris.cpf (WebServer port = 52773)
status: running, since Fri Mar 20 07:50:08 2026
SuperServers: 1972
state: warn
product: InterSystems IRIS
Mon Mar 23 07:06:34 AM UTC 2026
[2] Starting BurstWriter load in background...

Node: SISHA820G2-21, Instance: IRIS

EPIC_DB>

EPIC_DB>
[3] Snapshot status before APP-CONS creation...
SnapShot_name P/S STAT Serial# LDEV# MU# P-LDEV# PID % MODE SPLT-TIME SLU C_LDEV# P R D_STAT RETENTION(H)
MP-0 P-VOL PAIR 810019 10 3 30 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 11 3 31 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 12 3 32 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 13 3 33 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 14 3 34 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 15 3 35 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 16 3 36 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 17 3 37 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 18 3 38 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 19 3 39 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 20 3 40 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 21 3 41 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 22 3 42 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 23 3 43 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 24 3 44 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 25 3 45 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 26 3 46 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 27 3 47 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 28 3 48 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 29 3 49 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 70 3 180 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 71 3 181 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 72 3 182 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 73 3 183 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 74 3 184 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 75 3 185 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 76 3 186 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 77 3 187 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 78 3 188 0 - G--AR------- - - - N D PAIR -
MP-0 P-VOL PAIR 810019 79 3 189 0 - G--AR------- - - - N D PAIR -
=================================================
4. Application-Consistent Snapshot Start
=================================================
[2026-03-23 07:07:35] [4.1] Freezing IRIS Instance: iris (Namespace: Epic_DB)
Mon Mar 23 07:07:35 AM UTC 2026

Command-line external freeze succeeded.
[2026-03-23 07:07:36] Checking WDSUSPD (expected 1)...
[2026-03-23 07:07:37] IRIS Freeze OK (WDSUSPD=1)
Mon Mar 23 07:08:37 AM UTC 2026
[2026-03-23 07:08:47] [4.2] Freezing XFS on mount point: /testDB
Mon Mar 23 07:08:47 AM UTC 2026
[2026-03-23 07:08:47] XFS Freeze OK
Mon Mar 23 07:08:47 AM UTC 2026
[2026-03-23 07:09:17] [4.3] Splitting TIA Snapshot using script...
Mon Mar 23 07:09:17 AM UTC 2026
[Mon Mar 23 07:09:21 AM UTC 2026] --> Split command accepted successfully.
[2026-03-23 07:09:21] Snapshot Split Triggered
Mon Mar 23 07:09:31 AM UTC 2026
[2026-03-23 07:09:41] [4.4] Unfreezing XFS...
Mon Mar 23 07:09:41 AM UTC 2026
[2026-03-23 07:09:41] XFS Unfreeze OK
[2026-03-23 07:09:41] [4.5] Thawing IRIS Instance: iris
Mon Mar 23 07:09:41 AM UTC 2026

Command-line external thaw succeeded.
[2026-03-23 07:09:42] Checking WDSUSPD (expected 0)...
[2026-03-23 07:09:43] IRIS Thaw OK (WDSUSPD=0)
[2026-03-23 07:09:43] [4.6] Validating Snapshot Details...
SnapShot_name P/S STAT Serial# LDEV# MU# P-LDEV# PID % MODE SPLT-TIME SLU C_LDEV# P R D_STAT RETENTION(H)
MP-0 P-VOL PSUS 810019 10 3 30 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 11 3 31 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 12 3 32 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 13 3 33 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 14 3 34 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 15 3 35 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 16 3 36 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 17 3 37 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 18 3 38 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 19 3 39 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 20 3 40 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 21 3 41 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 22 3 42 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 23 3 43 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 24 3 44 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 25 3 45 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 26 3 46 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 27 3 47 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 28 3 48 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 29 3 49 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 70 3 180 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 71 3 181 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 72 3 182 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 73 3 183 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 74 3 184 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 75 3 185 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 76 3 186 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 77 3 187 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 78 3 188 0 - G--AR------- 69c0e725 - - N D PSUS -
MP-0 P-VOL PSUS 810019 79 3 189 0 - G--AR------- 69c0e725 - - N D PSUS -
=================================================
Application-Consistent Snapshot Completed
=================================================
=================================================
Executing post-restore steps on h2
=================================================
[10] Performing FC LIP & SCSI scan...
[10] Restarting multipath...
[11] Activating volume groups...
1 logical volume(s) in volume group "Iris_vg_WIJ" now active
1 logical volume(s) in volume group "Iris_vg_JNL" now active
1 logical volume(s) in volume group "Iris_vg_DB" now active
3 logical volume(s) in volume group "rhel_sisha820g2-33" now active
[12] Mounting filesystem...
Filesystem Size Used Avail Use% Mounted on
devtmpfs 4.0M 0 4.0M 0% /dev
tmpfs 63G 0 63G 0% /dev/shm
tmpfs 26G 19M 25G 1% /run
/dev/mapper/rhel_sisha820g2--33-root 70G 8.8G 62G 13% /
/dev/sda2 960M 261M 700M 28% /boot
/dev/sda1 599M 7.1M 592M 2% /boot/efi
/dev/mapper/rhel_sisha820g2--33-home 1.1T 7.3G 1.1T 1% /home
172.23.102.10:/ctlopennfs 24T 20T 4.0T 84% /CTLOPENshare
172.23.102.10:/scripts 5.6T 4.6T 1016G 83% /scripts
tmpfs 13G 4.0K 13G 1% /run/user/0
/dev/mapper/Iris_vg_DB-Iris_DB 800G 15G 786G 2% /testDB
/dev/mapper/Iris_vg_JNL-Iris_JNL 200G 1.8G 199G 1% /JNL
/dev/mapper/Iris_vg_WIJ-Iris_WIJ 200G 1.6G 199G 1% /WIJ
Fixing ownership...
Ownership fix completed.
[13] Starting IRIS...
Using 'iris.cpf' configuration file

Now attempting WIJ compare, /WIJ/IRIS.WIJ
**WIJ blocks NOT matching the database ones are saved in MISMATCH.WIJ

Starting Control Process
Global buffer setting requires attention. Auto-selected 25% of total memory.
Allocated 36510MB shared memory
32017MB global buffers, 1020MB routine buffers
Starting IRIS
InterSystems IRIS is started in single user mode.
To log into InterSystems IRIS, type:
iris session IRIS -B
and D ^STURECOV for help recovering from this error.

Configuration 'IRIS'
directory: /IRIS
versionid: 2025.2.0.227.0com
datadir: /IRIS
conf file: iris.cpf (WebServer port = 52773)
status: sign-on inhibited, last used Mon Mar 23 07:05:13 2026
SuperServers: 1972
product: InterSystems IRIS
Sign-on inhibited: Startup or Installation in progress

Product version: IRIS 2025.2

Discussion (1)0

Add reply

Comments

Malaya Acharya · Mar 24

Messages logs is as follows:

*** Recovery started at Tue Mar 24 08:03:11 2026
Current default directory: /IRIS/mgr
Log file directory: /IRIS/mgr/
WIJ file spec: /WIJ/IRIS.WIJ
Recovering local (/WIJ/IRIS.WIJ) image journal file...
Starting WIJ recovery for '/WIJ/IRIS.WIJ'.
0 blocks pending in this WIJ.
WIJ pass # is 0.
Starting fast WIJ compare
Finished comparing 46897 blocks in 1 seconds
**WIJ blocks NOT matching the database ones are saved in MISMATCH.WIJ
03/24/26-08:03:12:363 (17204) 0 [Generic.Event] Global buffer setting requires attention. Auto-selected 25% of total memory.
03/24/26-08:03:12:520 (17204) 0 [Generic.Event] Allocated 36510MB shared memory
03/24/26-08:03:12:520 (17204) 0 [Generic.Event] 32017MB global buffers, 1020MB routine buffers, 64MB journal buffers, 2427MB buffer descriptors, 960MB heap, 5MB ECP, 16MB miscellaneous
03/24/26-08:03:12:522 (17204) 0 [Crypto.IntelSandyBridgeAESNI] Intel Sandy Bridge or AMD x8 AES-NI instructions detected.
03/24/26-08:03:12:522 (17204) 0 [SIMD] SIMD optimization level: AVX2
03/24/26-08:03:13:039 (17204) 0 [WriteDaemon.UsingWIJFile] Using WIJ file: /WIJ/IRIS.WIJ
03/24/26-08:03:13:039 (17204) 0 [Generic.Event] Jrn info from prior WIJ (imflags: 0):
wdpass: 0
jrnwdpass: 24
fspec: /JNL/JNL01/20260324.337
filecnt: 1203
fileoff: 162224368
prevfcnt: 1192
prevfileoeff: 97930564
min trans cnt: 1192
min trans index: 97930564
03/24/26-08:03:13:041 (17204) 0 [Generic.Event]
Startup of InterSystems IRIS [IRIS for UNIX (Red Hat Enterprise Linux 9 for x86-64) 2025.2 (Build 227U) Thu Jul 10 2025 11:11:23 EDT]
in /IRIS/bin/
with mgr: /IRIS/mgr
with wij: /WIJ/IRIS.WIJ
from: /IRIS/mgr/
OS=[Linux], version=[#1 SMP PREEMPT_DYNAMIC Wed Apr 10 10:29:16 EDT 2024], release=[5.14.0-427.13.1.el9_4.x86_64], machine=[x86_64]
nodename=[SISHA820G2-33].
numasyncwijbuf: 2, wdwrite_asyncio_max: 64, wijdirectio: on, synctype: 3
System Initialized.

0 0