Kubernetes Job Cluster - Checkpointing with Parallelism > 1

Kubernetes Job Cluster - Checkpointing with Parallelism > 1

Hi all,

We are trying to configure checkpointing (RocksDb) for flink job clusters in k8s. As described
here we have a parallelism value that is used as the -Dparallelism.default arg in the job manager
template as well as the replicas value in the task manager
template. For jobs where the parallelism value is set to 1 checkpointing works great. But when we set the parallelism value to anything > 1 we get the below error:

This email is confidential and subject to important disclaimers and conditions including on offers for purchase or sale of securities accuracy and completeness of information viruses
confidentiality legal privilege and legal entity disclaimers available at www.neovest.com/disclosures.html

This email is confidential and subject to important disclaimers and conditions including on offers for purchase or sale of securities accuracy and completeness of information viruses
confidentiality legal privilege and legal entity disclaimers available at www.neovest.com/disclosures.html

We are trying to configure checkpointing (RocksDb) for flink job clusters in k8s. As described
here we have a parallelism value that is used as the -Dparallelism.default arg in the job manager
template as well as the replicas value in the task manager
template. For jobs where the parallelism value is set to 1 checkpointing works great. But when we set the parallelism value to anything > 1 we get the below error:

This email is confidential and subject to important disclaimers and conditions including on offers for purchase or sale of securities accuracy and completeness of information viruses
confidentiality legal privilege and legal entity disclaimers available at www.neovest.com/disclosures.html