Apache Spark Now a Top-level Apache Project

We are delighted with the recent announcement of the Apache Software Foundation that Apache Spark has become a top-level Apache project. This is a recognition of the fantastic work done by the Spark open source community, which now counts over 140 developers from 30+ companies.

In short time, Spark has become an increasingly popular solution for numerous big data applications, including machine learning, interactive queries, and stream processing. Spark now is an integral part of the Hadoop ecosystem, with many organizations employing Spark to perform sophisticated processing on their Hadoop data.

At Databricks we are looking forward to continuing our work with the open source community to accelerate the development and adoption of Apache Spark. Currently employing the lead developers and creators of many of the components of the Spark ecosystem, including Matei Zaharia, the creator of Spark, and Patrick Wendell, the release manager of Spark, we are committed to the success of Apache Spark.