2575957 - Persistence service issues

• When installing persistence service from the Gateway Management cockpit on cloud, an error occurs and we need to try more the one time to deploy the bundles correctly. 
• The persistence service doesn't start propertly on the edge gateway showing the following error : 

07Dec 12:56:39,537 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:958) - Extracting dependencies to:com/sap/iot/edgeservices/persistenceservice
07Dec 12:56:39,537 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:1006) - Extracting: com/sap/iot/edgeservices/persistenceservice/user.sql
07Dec 12:56:39,537 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:1006) - Extracting: com/sap/iot/edgeservices/persistenceservice/schema.sql
07Dec 12:56:39,538 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:1006) - Extracting: com/sap/iot/edgeservices/persistenceservice/procedure.sql
07Dec 12:56:39,538 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:1006) - Extracting: com/sap/iot/edgeservices/persistenceservice/event.sql
07Dec 12:56:39,538 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:1006) - Extracting: com/sap/iot/edgeservices/persistenceservice/metadata.sql
07Dec 12:56:39,538 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:630) - createDatabase database already exists, skipping create:/opt/edge/gateway_REST/com/sap/iot/edgeservices/persistenceservice/PersistenceService.db
07Dec 12:56:39,746 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:704) - cmd dbping rc:1  results:SQL Anywhere Server Ping Utility Version 17.0.8.4003
Ping database failed -- Invalid user ID or password.
 cmd:./com/sap/iot/edgeservices/sqlanywhere/17.0.8/bin64/dbping -d @com/sap/iot/edgeservices/persistenceservice/connection.txt
07Dec 12:56:39,952 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:744) - cmd dbspawn rc:1  results:SQL Anywhere Start Server In Background Utility Version 17.0.8.4003
DBSPAWN ERROR:  -96
Database server already running
 cmd:./com/sap/iot/edgeservices/sqlanywhere/17.0.8/bin64/dbspawn -f ./com/sap/iot/edgeservices/sqlanywhere/17.0.8/bin64/dbsrv17 @com/sap/iot/edgeservices/persistenceservice/dbsrv.txt
07Dec 12:56:40,022 [DefaultMessageListenerContainer-1] INFO  (SQLAnywherePersistence:753) - cmd dbsrv17 respawning due to error rc:21  results:Unable to start database server
 cmd:./com/sap/iot/edgeservices/sqlanywhere/17.0.8/bin64/dbsrv17 -ud -n PersistenceService_sapedge -x tcpip(port=60000) -gd all -gk all -ec simple -ot /opt/edge/gateway_REST/com/sap/iot/edgeservices/persistenceservice/eng.txt -os 10M /opt/edge/gateway_REST/com/sap/iot/edgeservices/persistenceservice/PersistenceService.db
07Dec 12:56:40,022 [DefaultMessageListenerContainer-1] ERROR (SQLAnywherePersistence:258) - Cannot start database server
07Dec 12:56:40,022 [DefaultMessageListenerContainer-1] INFO  (PersistenceFactory:32) - Successfully started SQL Anywhere persistence class
07Dec 12:56:40,022 [DefaultMessageListenerContainer-1] INFO  (PersistenceActivator:128) - No defined Measures available
07Dec 12:56:40,022 [DefaultMessageListenerContainer-1] INFO  (PersistenceActivator:130) - Testing DB connection
07Dec 12:56:40,023 [DefaultMessageListenerContainer-1] ERROR (SQLAnywherePersistence:2233) - getSystemConfig: Database not running
07Dec 12:56:40,023 [DefaultMessageListenerContainer-1] INFO  (PersistenceActivator:142) - EdgeFoundryPersistence factory startup complete
07Dec 12:56:40,023 [DefaultMessageListenerContainer-1] INFO  (PersistenceActivator:632) - Properties connection check
07Dec 12:56:40,024 [DefaultMessageListenerContainer-1] INFO  (PersistenceActivator:652) - Properties connection check scheduled with interval 2 minutes
07Dec 12:56:40,027 [DefaultMessageListenerContainer-1] ERROR (APIService:267) - Error while normalising the xml doc Content is not allowed in prolog.
07Dec 12:56:40,027 [DefaultMessageListenerContainer-1] INFO  (KeepAliveStarter:64) - *** BUNDLE 256 EVENT for PersistenceService_3.1711.0 [208] - ID=208
07Dec 12:56:40,029 [DefaultMessageListenerContainer-1] INFO  (KeepAliveStarter:64) - *** BUNDLE 4 EVENT for PersistenceService_3.1711.0 [208] - ID=208
07Dec 12:56:40,033 [DefaultMessageListenerContainer-1] ERROR (DoryFaultInterceptor:46) - Exception: Plat1ValidationException
org.apache.cxf.interceptor.Fault: Plat1ValidationException
 at org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:170) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.jaxws.AbstractJAXWSMethodInvoker.createFault(AbstractJAXWSMethodInvoker.java:272) ~[cxf-rt-frontend-jaxws-2.7.14.jar:2.7.14]
 at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:136) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.jaxws.AbstractJAXWSMethodInvoker.invoke(AbstractJAXWSMethodInvoker.java:237) ~[cxf-rt-frontend-jaxws-2.7.14.jar:2.7.14]
 at org.apache.cxf.jaxws.JAXWSMethodInvoker.invoke(JAXWSMethodInvoker.java:69) ~[cxf-rt-frontend-jaxws-2.7.14.jar:2.7.14]
 at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:75) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) ~[cxf-api-2.7.14.jar:2.7.14]
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_131]
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_131]
 at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:107) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272) [cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) [cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.transport.jms.JMSDestination.onMessage(JMSDestination.java:243) [cxf-rt-transports-jms-2.7.14.jar:2.7.14]
 at org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:555) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:515) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:485) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.doReceiveAndExecute(AbstractPollingMessageListenerContainer.java:325) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.receiveAndExecute(AbstractPollingMessageListenerContainer.java:263) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.invokeListener(DefaultMessageListenerContainer.java:1103) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.executeOngoingLoop(DefaultMessageListenerContainer.java:1095) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.run(DefaultMessageListenerContainer.java:992) [org.apache.servicemix.bundles.spring-jms-3.2.17.RELEASE_1.jar:?]
 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
Caused by: com.sap.iotservices.exceptions.REBundleOperationException: Plat1ValidationException
 at com.sap.iotservices.gateway.core.DoryStateManager.postServiceFile(DoryStateManager.java:2393) ~[gateway-core-4.12.0.jar:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131]
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131]
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
 at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:188) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:104) ~[cxf-api-2.7.14.jar:2.7.14]
 ... 20 more
Caused by: org.osgi.framework.BundleException: Exception in com.sap.iot.edgeservices.persistenceservice.db.PersistenceActivator.start() of bundle PersistenceService.
 at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:795) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.container.Module.doStart(Module.java:581) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.container.Module.start(Module.java:449) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402) ~[org.eclipse.osgi.jar:?]
 at com.sap.iotservices.osgiutils.impl.OSGIUtils.startBundle(OSGIUtils.java:60) ~[?:?]
 at com.sap.iotservices.gateway.core.DoryStateManager.postServiceFile(DoryStateManager.java:2391) ~[gateway-core-4.12.0.jar:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131]
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131]
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
 at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:188) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:104) ~[cxf-api-2.7.14.jar:2.7.14]
 ... 20 more
Caused by: java.lang.NullPointerException
 at com.sap.iot.edgeservices.persistenceservice.db.APIService.isCentralModel(APIService.java:225) ~[bundleFile:?]
 at com.sap.iot.edgeservices.persistenceservice.db.PersistenceActivator.start(PersistenceActivator.java:162) ~[bundleFile:?]
 at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:774) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:1) ~[org.eclipse.osgi.jar:?]
 at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131]
 at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:767) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.container.Module.doStart(Module.java:581) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.container.Module.start(Module.java:449) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383) ~[org.eclipse.osgi.jar:?]
 at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402) ~[org.eclipse.osgi.jar:?]
 at com.sap.iotservices.osgiutils.impl.OSGIUtils.startBundle(OSGIUtils.java:60) ~[?:?]
 at com.sap.iotservices.gateway.core.DoryStateManager.postServiceFile(DoryStateManager.java:2391) ~[gateway-core-4.12.0.jar:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131]
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131]
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
 at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:188) ~[cxf-api-2.7.14.jar:2.7.14]
 at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:104) ~[cxf-api-2.7.14.jar:2.7.14]
 ... 20 more

IOT Edge Services 3.0

Edge Gateway, IOT, PersistenceService, TN1Q57_REST, config_gateway , KBA , IOT-EDG , Edge Services , Problem