• YouTube

Description

PyData Berlin 2016

Python machine learning libraries like scikit-learn are a fantastic resource but not always well suited to large datasets. How can we use Python for machine learning in such cases? This talk will introduce PySpark and MLlib as tools for distributed machine learning. We will discuss what these tools are, how they work, and cover some basic code examples of machine learning on a cluster.

1. Intro

   1. Why is scikit-learn not enough?
   2. What is Spark?
   3. What is MLlib?

2. Spark

   1. Overview of Spark
   2. Overview of PySpark
   3. PySpark code sample

3. MLlib

   1. Overview of MLlib
   2. MLlib code samples