Spark UI History server on Kubernetes

Spark UI History server on Kubernetes

Hello,

We are running Spark 2.4 on Kubernetes cluster, able to access the Spark UI using "kubectl port-forward".

However, this spark UI contains currently running Spark application logs, we would like to maintain the 'completed' spark application logs as well. Could someone help us to setup 'Spark History server' on Kubernetes. Thanks!

We are running Spark 2.4 on Kubernetes cluster, able to access the Spark UI using "kubectl port-forward".

However, this spark UI contains currently running Spark application logs, we would like to maintain the 'completed' spark application logs as well. Could someone help us to setup 'Spark History server' on Kubernetes. Thanks!

We are running Spark 2.4 on Kubernetes cluster, able to access the Spark UI using "kubectl port-forward".

However, this spark UI contains currently running Spark application logs, we would like to maintain the 'completed' spark application logs as well. Could someone help us to setup
'Spark History server' on Kubernetes. Thanks!

We are running Spark 2.4 on Kubernetes cluster, able to access the Spark UI using "kubectl port-forward".

However, this spark UI contains currently running Spark application logs, we would like to maintain the 'completed' spark application logs as well. Could someone help us to setup
'Spark History server' on Kubernetes. Thanks!