Aurobindo Sarkar's Learning Spark SQL PDF

Key Features

• Learn in regards to the layout and implementation of streaming functions, laptop studying pipelines, deep studying, and large-scale graph processing purposes utilizing Spark SQL APIs and Scala.
• Learn facts exploration, information munging, and the way to strategy established and semi-structured info utilizing real-world datasets and achieve hands-on publicity to the problems and demanding situations of operating with noisy and "dirty" real-world data.
• Understand layout issues for scalability and function in web-scale Spark program architectures.

Book Description

In the earlier 12 months, Apache Spark has been more and more followed for the improvement of allotted functions. Spark SQL APIs offer an optimized interface that is helping builders construct such functions speedy and simply. despite the fact that, designing web-scale construction functions utilizing Spark SQL APIs could be a complicated job. as a result, knowing the layout and implementation top practices earlier than you begin your venture may help you stay away from those problems.

This ebook supplies an perception into the engineering practices used to layout and construct real-world, Spark-based functions. The book's hands-on examples provides you with the mandatory self belief to paintings on any destiny initiatives you stumble upon in Spark SQL.

It starts off via familiarizing you with facts exploration and knowledge munging projects utilizing Spark SQL and Scala. huge code examples may also help you recognize the equipment used to enforce common use-cases for varied different types of functions. you'll get a walkthrough of the major techniques and phrases which are universal to streaming, computer studying, and graph purposes. additionally, you will learn the way such structures are architected and deployed for a winning supply of your undertaking. ultimately, you are going to flow directly to functionality tuning, the place you are going to study useful counsel and tips to get to the bottom of functionality issues.

What you'll learn

• Familiarize your self with Spark SQL programming together with operating with DataFrame/Dataset API and SQL.
• Perform a sequence of hands-on workouts with sorts of info resource together with CSV, JSON, Avro, MySQL, and MongoDB.
• Perform information caliber exams, info visualization, and easy statistical research tasks.
• Perform info munging initiatives on publically on hand datasets.
• Learn to take advantage of Spark SQL and SparkR for average facts technological know-how tasks.
• Learn key performance-tuning suggestions and methods in Spark SQL applications
• Learn to spot circumstances the place Spark SQL can be utilized in large-scale program architectures.

About the Author

Aurobindo Sarkar is presently the rustic Head (India Engineering middle) for ZineOne Inc. With a profession spanning 24+ years, he has consulted at the various top agencies in India, US, united kingdom, and Canada. He makes a speciality of real-time web-scale architectures, computer studying, deep studying, Cloud Engineering, and large information Analytics. Aurobindo has been actively operating as a CTO in know-how startups for over 8 years now. As a member of the pinnacle management group at a variety of startups, he has mentored founders and CxOs, supplied expertise advisory prone, and led product structure and engineering teams.