We are attempting to use a pod template for the executor to expose a JMX port for exporting metrics. While the pod template works for the driver — with the JMX port being created and the template successfully mounted at /opt/spark/pod-template — the same template is not being applied to the executor.
For more details, you can refer to the Jira ticket I raised,
The following Spark properties are also being passed during job submission:
spark.kubernetes.driver.podTemplateFile=s3a://mybucket/code/driver-pod-template.yaml spark.kubernetes.executor.podTemplateFile=s3a://mybucket/code/exec-pod-template.yaml Despite these configurations, the executor pod template does not appear to take effect.
发布者:admin,转转请注明出处:http://www.yc00.com/questions/1745309059a4621890.html
评论列表(0条)