Contribute Media
A thank you to everyone who makes this possible: Read More

Creating Python Data Pipelines in the Cloud

Description

PyData DC 2016

My talk will be an analysis of the various approaches to creating data pipelines the public cloud using Python.I will compare and contrast using various Python libraries such as Luigi, Airflow and native cloud frameworks such as Cloud Dataflow (Google), AWS Data Pipeline to create a real world data pipeline in Amazon AWS and Google Compute Engine.

Details

Improve this page