apache spark - Can we perform DML and write operations when optimation of delta table is in progress? - Stack Overflow

In the documentation, they have mentioned that read operations are allowed during optimize operation, b

In the documentation, they have mentioned that read operations are allowed during optimize operation, but nothing is mentioned about write and DML operations. If it is possible, can some one provide the link to the documention for same?

In the documentation, they have mentioned that read operations are allowed during optimize operation, but nothing is mentioned about write and DML operations. If it is possible, can some one provide the link to the documention for same?

Share Improve this question asked Mar 7 at 8:35 Shailendra KirtikarShailendra Kirtikar 474 bronze badges
Add a comment  | 

1 Answer 1

Reset to default 1

Delta format is designed to handle concurrent operations. While OPTIMIZE is running, other write and DML operations (like INSERT, UPDATE, DELETE, MERGE) can generally proceed. Delta's transactional guarantees ensure that these concurrent operations are handled correctly, maintaining data consistency.

NOTE: However, heavy concurrent write operations during an optimize operation could increase the time it takes to complete the optimize operation.

发布者:admin,转转请注明出处:http://www.yc00.com/questions/1744941613a4602358.html

相关推荐

发表回复

评论列表(0条)

  • 暂无评论

联系我们

400-800-8888

在线咨询: QQ交谈

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息

关注微信