3730440 - [RESOLVED] Merge activity fails in a SAP Hana Data Lake files space and remote source connection error – SAP Datasphere

Since 19th of March below issues occurred in Datasphere tenant:

• Task chain in a space of type "SAP HANA Data Lake Files" failed with error.
• An error occurs during the "Merge" activity.
• Error message includes: SQL error 2048: column store error: "DWC_GLOBAL"."LTF_MERGE" … "DWC_GLOBAL"."LTF_UPDATE_STATISTICS_INBOUND_BUFFER":line 103 col 2 (at pos 4129): search table error: [2620] executor: plan operation failed;Could not connect to remote source....LS_SM_SPARK_300 (adapter type: spark)....  Error:Registration failed spgwSessionId:...error:[com.sap.bds.storagegateway.exception.SgwHttpRuntimeException: Error sending HTTP request 
• Error while deploying replication flow showing the following details in the error message:
  "Unable to connect remote source: Registration failed spgwSessionId:.... error:[com.sap.bds.storagegateway.exception.SgwHttpRuntimeException: Error sending HTTP request, 
    ...(adapter type: spark, source name: XXXX.LS_SM_SPARK_001) Deployment failed for replication flow... Error occurred while deploying target tables".

SAP Datasphere

1. Create a task chain/ replication flow in a space of type "SAP HANA Data Lake Files".
2. Include a local table in the task chain.
3. Select the "Merge" activity for the local table.
4. Deploy the task chain, replication flow
5. Run the task chain.
6. Open the Data Integration Monitor and review the log for the error message.

20.03.2025 11:00 UTC - Development team is aware of this issue and currently investigating it.  Please follow this KBA for updates.

20.03.2025 15:30 UTC - Development team has identified the issue and fix is in deployment.

23.03.2025 09:30 UTC - The problem has been already fixed. However, the issue still remains for the tenants are currently hosted in the BR20 region. Our development team is working on the resolution.

23.03.2025 20:00 UTC - The issue with BR20 landscape has been solved. 

sql error 2048, LTF_UPDATE_STATISTICS_INBOUND_BUFFER, column store error, [2620] executor plan operation failed, merge activity, hana data lake files, data lake files, remote source connection, registration failed, sgwhttpruntimeexception, storage gateway, spark adapter, task chain, could not connect to remote source, error while deploying replication flow, error occurred while deploying target tables, datasphere space , KBA , DS-DI , Data Integration/Data Builder , DS-DI-SCH , Scheduling and Task Chains , DS-SM , Space Management , Problem