3806607 - [CamelJdbcAdapter] "Unknown table type is found: CatalogTableType(UNKNOWN_TABLE)" when browsing Databricks - SAP HANA Smart Data Integration

• Unable to access schema metadata from Databricks, even though the connection validates.
• Some schemas are inaccessible or show no tables, while others work correctly.
• The following error message is thrown in framework.trc:
  [ERROR] [] DPFramework | WorkerThread.processRequest [] - com.sap.hana.dp.adapter.sdk.AdapterException: [Driver error] Failed to browse metadata. Reason: Error while receiving response from Thrift server. Request {TGetTablesReq(sessionHandle:TSessionHandle(sessionId:THandleIdentifier(guid:<>, secret:<>)), catalogName:<name>, schemaName:<name>, tableName:%, getDirectResults:TSparkGetDirectResults(maxRows:2000000, maxBytes:404857600), runAsync:true)}, Error {Operation failed with error: [no error details from server] for statement [], with response [TGetOperationStatusResp(status:TStatus(statusCode:SUCCESS_STATUS), operationState:ERROR_STATE, sqlState:08000, errorCode:0, errorMessage:org.apache.hive.service.cli.HiveSQLException: Error operating GET_TABLES Unknown table type is found: CatalogTableType(UNKNOWN_TABLE)
                                  at org.apache.spark.sql.hive.thriftserver.HiveThriftServerErrors$.hiveOperatingError(HiveThriftServerErrors.scala:66)
                                  at org.apache.spark.sql.hive.thriftserver.HiveThriftServerErrors$.hiveOperatingError(HiveThriftServerErrors.scala:60)
                                  at org.apache.spark.sql.hive.thriftserver.SparkOperation.parallelMap(SparkOperation.scala:318)
                                  at org.apache.spark.sql.hive.thriftserver.SparkOperation.parallelMap$(SparkOperation.scala:310)
                                  at org.apache.spark.sql.hive.thriftserver.SparkGetTablesOperation.parallelMap(SparkGetTablesOperation.scala:56)
                                  at org.apache.spark.sql.hive.thriftserver.SparkGetTablesOperation.listUnityCatalogTables(SparkGetTablesOperation.scala:178)
                                  at org.apache.spark.sql.hive.thriftserver.SparkGetTablesOperation.execute(SparkGetTablesOperation.scala:134)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation.$anonfun$wrappedExecute$1(SparkAsyncOperation.scala:174)
                                  at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
                                  at com.databricks.unity.UCSEphemeralState$Handle.runWith(UCSEphemeralState.scala:45)
                                  at com.databricks.unity.HandleImpl.runWith(UCSHandle.scala:103)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation.org$apache$spark$sql$hive$thriftserver$SparkAsyncOperation$$wrappedExecute(SparkAsyncOperation.scala:151)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation$$anon$2$$anon$3.$anonfun$run$2(SparkAsyncOperation.scala:109)
                                  at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
                                  at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:426)
                                  at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
                                  at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:196)
                                  at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:424)
                                  at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:418)
                                  at com.databricks.spark.util.PublicDBLogging.withAttributionContext(DatabricksSparkUsageLogger.scala:26)
                                  at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:470)
                                  at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:455)
                                  at com.databricks.spark.util.PublicDBLogging.withAttributionTags(DatabricksSparkUsageLogger.scala:26)
                                  at com.databricks.spark.util.PublicDBLogging.withAttributionTags0(DatabricksSparkUsageLogger.scala:71)
                                  at com.databricks.spark.util.DatabricksSparkUsageLogger.withAttributionTags(DatabricksSparkUsageLogger.scala:171)
                                  at com.databricks.spark.util.UsageLogging.$anonfun$withAttributionTags$1(UsageLogger.scala:495)
                                  at com.databricks.spark.util.UsageLogging$.withAttributionTags(UsageLogger.scala:607)
                                  at com.databricks.spark.util.UsageLogging$.withAttributionTags(UsageLogger.scala:616)
                                  at com.databricks.spark.util.UsageLogging.withAttributionTags(UsageLogger.scala:495)
                                  at com.databricks.spark.util.UsageLogging.withAttributionTags$(UsageLogger.scala:493)
                                  at org.apache.spark.sql.hive.thriftserver.SparkGetTablesOperation.withAttributionTags(SparkGetTablesOperation.scala:56)
                                  at org.apache.spark.sql.hive.thriftserver.ThriftLocalProperties.$anonfun$withLocalProperties$11(ThriftLocalProperties.scala:168)
                                  at com.databricks.spark.util.IdentityClaim$.withClaim(IdentityClaim.scala:48)
                                  at org.apache.spark.sql.hive.thriftserver.ThriftLocalProperties.withLocalProperties(ThriftLocalProperties.scala:167)
                                  at org.apache.spark.sql.hive.thriftserver.ThriftLocalProperties.withLocalProperties$(ThriftLocalProperties.scala:51)
                                  at org.apache.spark.sql.hive.thriftserver.SparkGetTablesOperation.withLocalProperties(SparkGetTablesOperation.scala:56)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation$$anon$2$$anon$3.run(SparkAsyncOperation.scala:109)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation$$anon$2$$anon$3.run(SparkAsyncOperation.scala:100)
                                  at java.security.AccessController.doPrivileged(Native Method)
                                  at javax.security.auth.Subject.doAs(Subject.java:422)
                                  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
                                  at org.apache.spark.sql.hive.thriftserver.SparkAsyncOperation$$anon$2.run(SparkAsyncOperation.scala:121)
                                  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
                                  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
                                  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
                                  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
                                  at java.lang.Thread.run(Thread.java:750)
                                  Caused by: java.lang.IllegalArgumentException: Unknown table type is found: CatalogTableType(UNKNOWN_TABLE)

• SAP Datasphere
• Databricks
• SAP HANA Smart Data Integration

Databricks, JDBC, SAP Datasphere, SDI, DP Agent, CamelJDBCAdapter, schema not listing, remote table import, UNKNOWN_TABLE, CatalogTableType , KBA , HAN-DP-SDI , SAP HANA smart data integration (SDI) , HAN-DP-SDI-DS , SAP Datasphere specific SDI issues , Problem