Unable to Perform Full Load from SAP BW to Azure Blob Storage After Using Delta Loads - Stack Overflow

I am working on extracting data from SAP BW and writing it to Azure Blob Storage using an ETL pipeline.

I am working on extracting data from SAP BW and writing it to Azure Blob Storage using an ETL pipeline. Initially, I experimented with delta/incremental loads, but now I need to perform a full load. However, after switching back, I am unable to get any data written to the sink. I'm using the SAP CDC connector. I have a solution running on another platform, where things are set up the exact same way, so my bet is that there is a checkpoint hidden somewhere on the server etc. that needs to be removed.

What I have tried:

  • I have deleted all queues in SAP BW to ensure there are no remnants of delta configurations.
  • I can see all rows in the staging area, which confirms that the data is successfully extracted from SAP BW. However, when writing to the Azure Blob Storage sink, the process completes but reports that 0 rows were copied.

Source:

Sink:

The issue seems to be on the sink side since the data is available in staging but doesn’t make it to Azure Blob Storage. There are no error messages, just an indication that no rows were written. Delta load configurations were previously in place, but I have removed them and expect a full load to work.

发布者:admin,转转请注明出处:http://www.yc00.com/questions/1745303127a4621558.html

相关推荐

发表回复

评论列表(0条)

  • 暂无评论

联系我们

400-800-8888

在线咨询: QQ交谈

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息

关注微信