Pega startup fails post 7.x to 8.7.3 upgrade

Background

Upgraded from 7.1.9 to 8.7.3

moved from jboss to tomcat

updated oracle 12c to 19c before update

Below error in logs during startup & app fails to startup

ga.pegarules.pub.database.DatabaseException: Database-General Problem reading class definitions 17430 99999 Must be logged on to server
DatabaseException caused by prior exception: java.sql.SQLException: Must be logged on to server
| SQL Code: 17430 | SQL State: 99999

From: (unknown)
SQL: select pzPVStream from PEGA_RULES_NEW.pr4_base where pxObjClass = ?
SQL Inserts:

Caused by SQL Problems.
Problem 1, SQLState 99999, Error code 17430: java.sql.SQLException: Must be logged on to server
2022-11-28 13:09:40,092 [StartUp-TaskExecutor] (ternal.dictionary.ClassMapImpl) INFO - ClassMapData is not preloaded
2022-11-28 13:09:40,092 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - ClassMap using multi-tenant environment: false
2022-11-28 13:09:40,093 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Reading the class group definitions
2022-11-28 13:09:40,123 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Read 155 class group definitions
2022-11-28 13:09:40,124 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Reading the class definitions
2022-11-28 13:09:40,124 [StartUp-TaskExecutor] (ccess.DatabaseImpl.SystemPulse) INFO - Using a pulse offset of 60000 ms
2022-11-28 13:10:40,854 [StartUp-TaskExecutor] ( internal.access.DatabaseImpl) INFO - Bytes input per interaction warning threshold: 50M
2022-11-28 13:10:40,854 [StartUp-TaskExecutor] (ternal.dictionary.ClassMapImpl) INFO - ClassMapData is not preloaded
2022-11-28 13:10:40,854 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - ClassMap using multi-tenant environment: false
2022-11-28 13:10:40,854 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Reading the class group definitions
2022-11-28 13:10:40,885 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Read 155 class group definitions
2022-11-28 13:10:40,885 [StartUp-TaskExecutor] (ary.ClassMapDatabasePageReader) INFO - Reading the class definitions
2022-11-28 13:11:46,452 [ rh0365v] ( internal.access.DatabaseImpl) INFO - Bytes input per interaction warning threshold: 50M
2022-11-28 13:11:46,453 [ rh0365v] (ternal.dictionary.ClassMapImpl) INFO - ClassMapData is not preloaded
2022-11-28 13:11:46,453 [ rh0365v] (ary.ClassMapDatabasePageReader) INFO - ClassMap using multi-tenant environment: false
2022-11-28 13:11:46,453 [ rh0365v] (ary.ClassMapDatabasePageReader) INFO - Reading the class group definitions
2022-11-28 13:11:46,483 [ rh0365v] (ary.ClassMapDatabasePageReader) INFO - Read 155 class group definitions
2022-11-28 13:11:46,484 [ rh0365v] (ary.ClassMapDatabasePageReader) INFO - Reading the class definitions
2022-11-28 13:12:52,282 [StartUp-TaskExecutor] ( internal.access.DatabaseImpl) INFO - Bytes input per interaction warning threshold: 50M
2022-11-28 13:12:52,282 [StartUp-TaskExecutor] (ternal.dictionary.ClassMapImpl) INFO - ClassMapData is not preloaded
2022-11-28 13:12:52,282 [ rh0365v] ( etier.impl.EngineStartup) ERROR - PegaRULES initialization failed. Server: unknown
com.pega.pegarules.pub.context.InitializationFailedError: PRNodeImpl init failed
at com.pega.pegarules.session.internal.mgmt.PREnvironment.getThreadAndInitialize(PREnvironment.java:442) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.PRSessionProviderImpl.getThreadAndInitialize(PRSessionProviderImpl.java:2169) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineStartup.initEngine(EngineStartup.java:726) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl._initEngine_privact(EngineImpl.java:180) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl.doStartup(EngineImpl.java:152) ~[prprivate-session.jar:?]
at com.pega.pegarules.web.servlet.WebAppLifeCycleListener._contextInitialized_privact(WebAppLifeCycleListener.java:216) ~[prwebj2ee.jar:?]
at com.pega.pegarules.web.servlet.AbstractLifeCycleListener._contextInitialized_privact(AbstractLifeCycleListener.java:145) ~[prwebj2ee.jar:?]
at com.pega.pegarules.web.servlet.AbstractLifeCycleListener.contextInitialized(AbstractLifeCycleListener.java:76) ~[prwebj2ee.jar:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:388) ~[prbootstrap-8.7.3-469.jar:8.7.3-469]
at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:430) ~[prbootstrap-8.7.3-469.jar:8.7.3-469]
at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:225) ~[prbootstrap-api-8.7.3-469.jar:8.7.3-469]
at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethod(AppServerBridgeToPega.java:274) ~[prbootstrap-api-8.7.3-469.jar:8.7.3-469]
at com.pega.pegarules.internal.web.servlet.WebAppLifeCycleListenerBoot.contextInitialized(WebAppLifeCycleListenerBoot.java:92) ~[prbootstrap-api-8.7.3-469.jar:8.7.3-469]
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:726) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:698) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:696) ~[catalina.jar:9.0.65]
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1024) ~[catalina.jar:9.0.65]
at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1911) ~[catalina.jar:9.0.65]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) ~[tomcat-util.jar:9.0.65]
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:118) ~[?:?]
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:825) ~[catalina.jar:9.0.65]
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:475) ~[catalina.jar:9.0.65]
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1618) ~[catalina.jar:9.0.65]
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:319) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:123) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:423) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:366) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:946) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386) ~[catalina.jar:9.0.65]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) ~[tomcat-util.jar:9.0.65]
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) ~[?:?]
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:265) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.65]
at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930) ~[catalina.jar:9.0.65]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.65]

@Tanul_Thanvi if you do not receive any input from the forum community I suggest that you log this as a support incident in the msp as this may require a thorough check on the full steps and logs from your upgrade.

Please provide the INC reference in this post so that we can help track progress.

@Tanul_Thanvi

Generally, this issue appears for below setting configured in your environment either as DSS setting or in prconfig.xml
reporting/retrieveFullClobContent

This needs dedicated troubleshooting, please submit the support incident

@PrakashKaragi Thanks for response! Have checked and it didn’t have the DSS or anything in prconfig.

What worked was invalidating and revalidating the prconfig file (say by commenting the env details, kicking in restart which fails and then again enabling the env details), a bit of hack but it worked.