Access the Spark History Server
Currently, the Spark History Server has only set up a ClusterIP. To expand access, port forward the server using kubectl
:
kubectl get pods -n [NAMESPACE] # to find the Spark History Server pod
kubectl port-forward [POD_NAME] -n [NAMESPACE] 18080:18080
You can now access the Spark History Server at http://localhost:18080
. Run a Spark job and confirm that you can see the logs appear in the UI.
For related topics, see Spark Operations.