kubernetes - User-specified executor pod templates are not working in Spark 3.3.1 - Stack Overflow

We are attempting to use a pod template for the executor to expose a JMX port for exporting metrics. Wh

We are attempting to use a pod template for the executor to expose a JMX port for exporting metrics. While the pod template works for the driver — with the JMX port being created and the template successfully mounted at /opt/spark/pod-template — the same template is not being applied to the executor.

For more details, you can refer to the Jira ticket I raised,

The following Spark properties are also being passed during job submission:

spark.kubernetes.driver.podTemplateFile=s3a://mybucket/code/driver-pod-template.yaml spark.kubernetes.executor.podTemplateFile=s3a://mybucket/code/exec-pod-template.yaml Despite these configurations, the executor pod template does not appear to take effect.

发布者:admin,转转请注明出处:http://www.yc00.com/questions/1745309059a4621890.html

相关推荐

发表回复

评论列表(0条)

  • 暂无评论

联系我们

400-800-8888

在线咨询: QQ交谈

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息

关注微信