Legacy Product

Fusion 5.10
    Fusion 5.10

    Clean Up Spark Driver Pods

    Spark driver pods are cleaned up using a Kubernetes cron job that runs every 15 minutes. This cron job is created automatically when the job-launcher microservice is installed in the Fusion cluster.

    To clean up pods manually, run this command:

    kubectl delete pods --namespace default --field-selector=status.phase=Succeeded -l spark-role=driver

    For related topics, see Spark Operations.