Just a future reminder for myself and anyone else mildly surprised by this configuration option, if you want concurrent jobs in Spark Streaming you need to set concurrentJobs to a value of more than 1 as expected e.g.