RDB writeBlock errors

[emaddocks]

Hi,

We've just upgraded our system from 3.17 P014 to 3.18 P004. We're running on RHEL 8.2 and using an Oracle 19c Standard Edition 2 database.

After upgrading WinCC OA (and running unix_upgrade 8.22 on the database) the connection to the database by the RDB manager looks to work fine...

Code: Select all

WCCILpmon    (1), 2021.10.13 16:11:23.657, SYS,  INFO,        1, Manager Start, /opt/WinCC_OA/3.18/bin/WCCOArdb -PROJ XXXPSS -pmonIndex 2 -num 99
WCCOArdb     (99), 2021.10.13 16:11:23.681, SYS,  INFO,        0, , The Manager is using the Archive Groups in the Database!
WCCOArdb     (97), 2021.10.13 16:11:23.681, SYS,  INFO,        1, Manager Start, PROJ, XXXPSS, V 3.18 - 3.18   platform Linux x86_64 linked at Sep 15 2021 21:34:09 (bb34a225dd5)
WCCOArdb     (97), 2021.10.13 16:11:23.682, SYS,  INFO,        3, Trying to connect to (SYS: 0 Data -num 0 CONN: 1) @ sscpssoa1-1:4897,sscpssoa1-2:4897
WCCOArdb     (97), 2021.10.13 16:11:23.682, SYS,  INFO,        4, Connected to (SYS: 0 Data -num 0 CONN: 1) @ localhost (127.0.0.1)
WCCOArdb     (97), 2021.10.13 16:11:23.700, SYS,  INFO,        0, , Internal Dp Value changed! It will take a few seconds that the Manager uses the Value changes.
WCCOArdb     (97), 2021.10.13 16:11:23.700, SYS,  INFO,        0, , Internal Dp Value changed! It will take a few seconds that the Manager uses the Value changes.
WCCOArdb     (97), 2021.10.13 16:11:23.700, SYS,  INFO,        0, , Internal DP stopWriteToDB is false
WCCOArdb     (97), 2021.10.13 16:11:23.700, SYS,  INFO,        0, , preferredHost was set to ORPSS_SID
WCCOArdb     (97), 2021.10.13 16:11:23.719, SYS,  INFO,        0, , RDB uses Oracle Client Version 19
WCCOArdb     (97), 2021.10.13 16:11:23.751, SYS,  INFO,        0, , Manager made a valid Connection to the Data Base [Write Connection OCCI]! (ORPSS_SID)
WCCOArdb     (97), 2021.10.13 16:11:23.779, SYS,  INFO,        0, , Manager made a valid Connection to the Data Base [Read Connection]! (ORPSS_SID)
WCCOArdb     (97), 2021.10.13 16:11:23.944, SYS,  INFO,        0, , Manager made 4 valid Connection(s) to the Data Base [Request Connection]! (ORPSS_SID)
WCCOArdb     (97), 2021.10.13 16:11:23.973, SYS,  INFO,        0, , Manager made a valid Connection to the Data Base [DP INFO Connection]! (ORPSS_SID)
WCCOArdb     (97), 2021.10.13 16:11:24.018, SYS,  INFO,        0, , Manager made a valid Connection to the Data Base [DP Delete Connection]! (ORPSS_SID)
WCCOArdb     (97), 2021.10.13 16:11:24.025, SYS,  INFO,        0, , DB Schema is 8.22 RDB needs to have the Version 8.1, This should be ok!
WCCOArdb     (97), 2021.10.13 16:11:24.029, SYS,  INFO,        0, , OCCI Support in DB is 1 and OCCI Support in PVSS is 1, This should be ok!
WCCOArdb     (97), 2021.10.13 16:11:24.639, SYS,  INFO,        0, , Manager received all Elements which have to be archived! Ready to work.
WCCOArdb     (97), 2021.10.13 16:11:25.193, SYS,  INFO,        0, , Internal Dp Value changed! It will take a few seconds that the Manager uses the Value changes.
WCCOArdb     (97), 2021.10.13 16:11:25.193, SYS,  INFO,        0, , Internal Dp Value changed! It will take a few seconds that the Manager uses the Value changes.
WCCOArdb     (97), 2021.10.13 16:11:25.193, SYS,  INFO,        0, , Internal DP stopWriteToDB is false
WCCOArdb     (97), 2021.10.13 16:11:25.194, SYS,  INFO,        0, , preferredHost was set to ORPSS_SID

However seconds after connection the following errors occur...

Code: Select all

WCCOArdb     (97), 2021.10.13 16:11:28.338, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:28.338, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:28.338, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:28.598, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:28.598, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:28.598, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:28.834, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:28.834, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:28.834, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.076, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:29.076, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.076, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.321, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:29.321, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.321, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.521, SYS,  WARNING,     2, Manager Stop, DBTransActions::insertBlockBulk - write Block as Single-Inserts not Bulk-Insert
WCCOArdb     (97), 2021.10.13 16:11:29.621, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:29.621, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.621, SYS,  SEVERE,      0, , Maximum amount of db writes reached! I'll drop Block and continue with the next!
WCCOArdb     (97), 2021.10.13 16:11:29.866, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:29.866, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:29.866, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.087, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:30.087, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.087, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.293, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:30.293, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.293, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.514, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:30.514, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.514, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.722, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:30.722, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.722, SYS,  SEVERE,      0, , writeBlock failed! Will try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.923, SYS,  WARNING,     2, Manager Stop, DBTransActions::insertBlockBulk - write Block as Single-Inserts not Bulk-Insert
WCCOArdb     (97), 2021.10.13 16:11:30.937, SYS,  WARNING,     0, , Bulk data NOT written into database!, ErrorCode: -1
WCCOArdb     (97), 2021.10.13 16:11:30.938, SYS,  SEVERE,      0, , Could not insert all Items into DB! Try to write Block again.
WCCOArdb     (97), 2021.10.13 16:11:30.938, SYS,  SEVERE,      0, , Maximum amount of db writes reached! I'll drop Block and continue with the next!

Looking into the Oracle databases EVENTHISTORY table the connection is still working as new values are being populated in the database.

Is there anything that needs to be done after upgrading to 3.18 P004 to resolve these errors?


Cheers
Eric

[emaddocks]

Following on from these warnings which we haven't been able to resolve we noticed that this looked to be related to the database sync (fwd) as our backup database no longer recieved data from the primary database.

We have now rebuilt the database from scratch. Re-installing the Oracle Standard Edition 2 database as a non-container / pluggable database as we thought this might be giving us problems.

If we run the RDB_config.sql file with 'way_of_backup' = 'datapump' we get the following error (on both pluggable and conventional databases):

Code: Select all

New schema user will be created: schemauser
New tablespace will be created: TS_schemauser
CREATE TABLESPACE TS_schemauser
DATAFILE SIZE 500M
AUTOEXTEND ON
ORA-02236: invalid file name
begin
*
ERROR at line 1:
ORA-02236: invalid file name
ORA-06512: at line 112
ORA-06512: at line 79

Does anyone know what could be causing this error?

[emaddocks]

Another update...

We were able to fix the "ORA-02236: invalid file name" error by adding a missing execute statement in the RDB_Schema_Useryes.sql file when 'datapump' is used as the 'way_of_backup' setting.

However this has not fixed our initial issue and are still getting the "writeBlock failed!" errors even when we create a new blank Legacy project without db forwarding. So as previously thought this is NOT related to the database sync (fwd) setup.

With the new Legacy project, once connected to the RDB, all we have to do is trigger the ExampleDP_AlertHdl1 DP (without an archive config) and the severe writeBlock failed errors come up in the log viewer. Thus it looks to be related to the ALERT archiving rather than EVENT archiving.

We have followed the installation guides in the 3.18 documentation including the one off patch https://www.winccoa.com/documentation/W ... l_19c.html

We tried the same with a new Legacy project on WinCC OA 3.17 P014 and got the same 'writeBlock failed!' errors.

We then tried the same with a new Legancy project on WinCC OA 3.17 P009 and didn't get any errors!


Has anyone else seen these errors since upgrading to the more recent WinCC OA patches?

[emaddocks]

To close out this bug:

A typo was found in the RDB_Valarch.sql file (bug introduced sometime after 3.17 P009). ETM plan to fix it in 3.17 P015 and 3.18 P005.

The bug was a missing '(' on Line 2397:
h.ts > s.partner - interval ''1'' second) AND h.ts < (s.partner + interval ''1'' second)

Correction:
h.ts > (s.partner - interval ''1'' second) AND h.ts < (s.partner + interval ''1'' second)