3708784 - S3 delta file uploads to Process Intelligence require full table uploads each time.

We want to upload new delta data from our AWS S3 data source to Process Intelligence each day. However, in Process Intelligence, it seems like we have to create a new connection or data object each time and merge them in the pipeline. This does not seem scalable. Are we missing something?

The inability to upload just the new delta data, is because the S3 connector we provide, supports only one file per table.

Our recommendation would be to setup an AWS Athena Connector against the S3 tables you are extracting data from.
Athena is a managed service on AWS, which doesn't require infrastructure setup, but just some minimum adjustments like creating the tables against S3.
In that way, you could append more files to S3 and have more control over how these are represented as tables.
Finally, you could then use our Athena connector to get that data into Signavio.

How to setup a connection between Signavio Process Intelligence and AWS Athena: https://help.sap.com/docs/signavio-process-intelligence/user-guide/connector-aws-athena?locale=en-US&

process, intelligence, delta, load, data, signavio, aws, bucket, table, soe , KBA , BPI-SIG-PI-DM , Data model / ETL for SAP Signavio Process Intelligence , Problem