3766209 - Read on a shared table fails with 403 authorization failure or access denied after firewall changes on Enterprise Databricks/Azure

• Data products shared from BDC-Datasphere to Enterprise Databricks on Azure via BDC connect, are visible on Databricks, but reading from the shared tables fails.
  
  
• Classic compute error: HTTP/1.1 403 AuthorizationFailure — “This request is not authorized to perform this operation.” org.apache.spark.SparkIOException.
  
  
• Serverless compute error: 
  Your request failed with status FAILED; [BAD_REQUEST] Error while reading file
  delta-sharing://... HTTP request failed with status: HTTP/1.1 403 Forbidden
  `<Code>AccessDenied</Code> <Message>Access to storage destination is denied
  because of serverless network policy</Message>` while accessing URI of shared table file.
  org.apache.spark.SparkIOException 
  
  
• The error appears in the Databricks Catalog Explorer (Sample Data tab), notebooks, SQL warehouses, or any workload accessing shared tables from BDC Connect.
  
  
• The problem occurs on restrictive network/firewall policies on Databricks; access works when relaxed network policies are used.

• SAP Business Data Cloud
• SAP Business Data Cloud Connect
• Enterprise Databricks on Azure

delta sharing, databricks, azure, BDC Connect, 403 authorization failure, access denied, serverless network policy, firewall, network policy, serverless compute, azure storage, sparkioexception, read failure, outbound access, shared table , KBA , BDC-CON , SAP Business Data Cloud Connect , Problem