Sign up or log in to save this to your schedule and see who's attending!

With the bloom of Apache spark, various big data applications shift to Spark pool to pursue better user experience. During the past, we partnered with several top China internet companies to build their next generation big data engine on Spark – including graph analysis, interactive, batch OLAP/BI and real-time analytics. In this talk, we will share our experience to further optimize not only the real-world applications but also in Apache Spark, which brought x5-100 speedup versus their original Map Reduce implements. Several lessons are gained for better user experience from building real-world Spark applications in production environment, which will be shared as well.

Grace Huang is currently an engineering manager in Intel SSG (Software and Services Group), responsible for advanced Big Data technology enhancement and optimization including Haodop, Spark and etc. Prior to that, she had been working in the big data area in Intel for over 6 years... Read More →